DataJobs.io
← Back to all jobs

Job Description

Data Engineer to design, implement, and maintain scalable, cost-efficient data pipelines and analytics solutions on Azure, collaborating with stakeholders to ensure data quality and enable enterprise analytics and reporting.

Responsibilities

  • Architect and sustain scalable data pipelines on Azure using services such as Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.
  • Ingest data from diverse sources including APIs, databases, and files into centralized analytics repositories.
  • Develop and manage ETL and ELT workflows to transform raw data into analytics-ready models aligned with business needs.
  • Design a microservices style architecture capable of rapid scaling with business growth and AI capabilities.
  • Build data pipelines that feed AI models with clean, structured logistics data.
  • Implement real-time analytics engines to empower predictive logistics capabilities.
  • Ensure data quality, integrity, and governance through validation, monitoring, and alerting mechanisms.
  • Collaborate with business and technical teams to capture data requirements and align data assets with business needs.
  • Apply cost-conscious data engineering strategies to optimize performance while managing cloud spend and storage costs.
  • Maintain and enhance a semantic data layer or curated datasets to support self-service BI with Power BI and advanced analytics.
  • Contribute to the architecture of the data platform with emphasis on security, scalability, and performance.
  • Automate data operations and deployment through CI/CD pipelines and infrastructure-as-code (ARM, Bicep, or Terraform).
  • Stay current with evolving Azure technologies and propose improvements to existing data workflows.
  • Other duties as assigned.

Requirements

  • Minimum 5 years of experience building and managing data pipelines in Microsoft Azure environments.
  • Proficiency with Azure Data Factory, Synapse Analytics, Data Lake, and Power BI integration.
  • Strong SQL, data modeling, and ELT/ETL pattern knowledge.
  • Experience working with APIs, JSON, and structured or unstructured data sources.
  • Proven ability to work cross-functionally to deliver high-quality data solutions.
  • Excellent organizational skills and ability to manage multiple tasks, set priorities, collaborate with diverse teams, and meet tight deadlines with attention to detail.
  • Flexible schedule availability as needed.
  • Proficient in Microsoft Office Suite.
  • Demonstrated leadership abilities with effective cross-functional communication and collaboration.
  • Attention to detail and compliance in a fast-paced environment.
  • Logistics or Supply Chain experience preferred.
  • Bachelor's Degree in an IT-related program.

Technologies

  • Azure Data Factory
  • Azure Synapse Analytics
  • Azure Data Lake
  • Power BI
  • SQL
  • JSON
  • Terraform
  • Bicep
  • ARM
  • Microsoft Office Suite

Benefits

  • Dental insurance
  • Health insurance
  • Life insurance
  • Paid time off

Physical Demands

  • Sitting at a desk, typing, viewing multiple screens, and responding to calls, emails, and messages throughout the day.
  • Occasionally bending, standing, or lifting up to 10 pounds.

Work Environment

The role is based in an open office setting with regulated temperatures and high phone activity.

Position Type & Hours

  • Full-time. Typically Monday through Friday, 8:00 am – 5:00 pm (1 hour lunch), 40+ hours per week.
  • Position may require hours outside the standard schedule as business needs dictate.

Travel

  • Minimal to no travel required; potential travel to conferences or trainings as needed.

Professional

  • Ability to adapt in a fast-paced environment and handle change with ease.
  • Efficient time management, punctuality, and reliability.
  • Foster teamwork, integrity, and leadership within the organization.
  • Clear written and verbal communication that is respectful and professional.

Similar Jobs