Data Factory Azure

Data Factory Azure Jobs

8 jobs found

Today

Senior Data Engineer (Must have Microsoft Fabric!)

MMD Services, Inc Downers Grove, IL

Downers Grove, IL

Today

$65 - $85/hr Full time Backend Developer Senior Azure

Apply Now

Job Description

Senior Data Engineer role focused on hands-on data architecture and prototyping across the Microsoft Azure stack, working closely with executive stakeholders and contributing to AI initiatives.

Design and architect data solutions across the Microsoft Azure stack, with direct hands-on build responsibility
Build prototypes and proofs of concept to validate architecture decisions before full-scale implementation
Translate C-suite requirements and KPIs into clear, actionable technical user stories for the engineering team
Provide technical direction by guiding and mentoring a team of mid-level and junior engineers supplied by an external vendor
Act as primary technical liaison between developers and business/executive stakeholders
Own architecture decisions for Synapse and Data Factory pipelines, focusing on scalability and performance
Contribute to the AI roadmap through AI POCs, Microsoft Copilot rollout, and early agentic AI initiatives
Present technical strategy and progress updates to non-technical executive audiences

Requirements

5+ years of hands-on experience in data architecture or lead data engineering roles
Hands-on architecture and lead engineering experience (design systems and build prototypes, not only advise)
Strong Microsoft Azure stack experience, including Azure Synapse and Azure Data Factory
Microsoft Fabric experience (must have)
Strong Python and SQL skills ( PySpark is a plus)
Exceptional communication skills to bridge technical and non-technical audiences
Experience guiding and mentoring junior and mid-level engineers

Technologies

Microsoft Azure
Azure Synapse
Data Factory
Microsoft Fabric
Python
SQL
PySpark
Databricks
Microsoft Copilot

Benefits

Flexible schedule

Nice to Have

Databricks experience (considered a bridge if you do not yet have Fabric hands-on time)
Interest or experience in AI, especially agentic AI agents, Copilot, or similar tools

Location: Downers Grove, IL (hybrid)

Pay: USD 65 - 85 per hourly

Experience: 5 years minimum

View full job page →

Today

Senior Data Engineer

NORTHEAST POWER COORDINATING COUNCIL (NPCC) Remote 🌍 Remote

Remote

Today

$105k - $125k/yr Full time Senior Azure Data Factory Business Intelligence

Apply Now

Job Description

Lead enterprise data engineering initiatives for NPCC by designing scalable data pipelines, cloud data platforms, and governed analytics foundations.

Responsibilities

Design, develop, implement, and maintain enterprise data architecture, scalable data pipelines, and cloud-based data platforms aligned to NPCC business objectives.
Build and optimize automated ELT/ETL workflows using modern integration technologies including Fivetran, dbt, APIs, and cloud-native services.
Develop and maintain enterprise data warehouses, semantic models, and analytical datasets using Snowflake and other modern cloud technologies.
Integrate and manage data from multiple internal NPCC departments, including Reliability Assessments and Performance Analysis (RAPA), System Protection, Compliance Monitoring and Enforcement, Registration, Event Analysis, Corporate Services, Finance, Information Technology, and other business functions.
Create and maintain integrations with external industry data sources including NERC applications, ERO Enterprise systems, Regional Entities, ISOs/RTOs, Transmission Owners, Generator Owners, governmental agencies, public data repositories, and other industry partners.
Design and implement enterprise data models for business intelligence, operational reporting, executive dashboards, regulatory reporting, and advanced analytics.
Develop, maintain, and optimize Power BI dashboards, reports, and interactive visualizations for organizational performance metrics and executive decision-making.
Implement automated data quality validation, reconciliation, monitoring, and alerting to support data integrity, accuracy, and reliability.
Establish and maintain metadata, data lineage, technical documentation, and data governance standards.
Collaborate with subject matter experts to translate business requirements into scalable technical solutions and reusable enterprise data products.
Evaluate emerging technologies and recommend improvements across enterprise data architecture, cloud platforms, analytics capabilities, automation processes, and AI initiatives.
Support organizational data governance, cybersecurity, and information management using industry best practices for secure and reliable data management.
Participate in cross-functional projects supporting NPCC strategic initiatives and continuous improvement.

Requirements

Bachelor's degree in Computer Science, Data Engineering, Information Systems, Computer Engineering, Electrical Engineering, Mathematics, Statistics, Data Analytics, or a related technical discipline.
Minimum 7 years of progressively responsible experience in data engineering, database development, enterprise data architecture, cloud data platforms, business intelligence, or analytics engineering.
Demonstrated experience designing and supporting enterprise-scale data platforms and automated data integration solutions.
Strong proficiency with SQL, Python, relational databases, and cloud-based data warehouse technologies.
Experience developing and maintaining ELT/ETL pipelines using modern integration tools and cloud technologies.
Experience delivering enterprise reporting and business intelligence solutions using Power BI or similar platforms.
Excellent verbal, written, and technical communication skills for technical and non-technical audiences.
Demonstrated analytical, organizational, and problem-solving skills with strong attention to detail.
Ability to manage multiple priorities independently while collaborating across departments.

Technologies

Fivetran, dbt, APIs, cloud-native services
Snowflake
Power BI
SQL, Python, relational databases
NERC applications, ERO Enterprise systems, ISOs/RTOs
NERC Reliability Standards
Microsoft Fabric, Azure Data Factory, Azure Synapse, Azure Data Lake
REST APIs, Git, Azure DevOps, CI/CD pipelines
artificial intelligence, machine learning

Benefits

401(k) and 401(k) matching
Dental insurance
Employee assistance program
Employee discount
Flexible schedule
Flexible spending account
Health insurance and Health savings account
Life insurance
Paid time off
Parental leave
Retirement plan
Vision insurance

Preferred Qualifications

Experience within the electric utility, electric reliability, transmission, generation, or energy industry.
Familiarity with NERC Reliability Standards, Regional Entity functions, and electric system operations.
Experience with modern cloud technologies including Snowflake, Microsoft Fabric, Azure Data Factory, Azure Synapse, Azure Data Lake, dbt, and Fivetran.
Experience with REST APIs, Git, Azure DevOps, CI/CD pipelines, and data automation frameworks.
Experience developing enterprise data governance programs, metadata management, and data quality frameworks.
Knowledge of artificial intelligence, machine learning, and predictive analytics technologies.

Skills and Abilities

Excellent verbal and written communication skills
Excellent interpersonal and conflict resolution skills
Excellent organizational skills and attention to detail
Strong analytical and problem-solving skills
Strong supervisory and leadership skills
Proficient with Microsoft Office Suite or related software
Self-starter who can manage multiple priorities in a fast-paced environment

Physical Demands

Ability to sit for long periods of time
Ability to communicate verbally and in writing
Ability to handle long periods of screen time
Ability to work and travel within the U.S. and travel to Canada

Application Question(s)

Do you have 5+ years of professional experience in data engineering, data architecture, database development, or analytics engineering?
Do you have hands-on experience designing, building, deploying, and maintaining production ETL/ELT data pipelines?
Do you have advanced hands-on experience with SQL and experience with a modern cloud data platform such as Snowflake, Microsoft Fabric, Databricks, Synapse, BigQuery, or Redshift?
Have you personally designed solutions that integrate multiple internal and external data sources, including databases, APIs, files, or third-party platforms, with automated data-quality validation and error handling?

Work location: Remote

Salary: USD 105,000 - 125,000 per year

Minimum experience: 7 years

Education: Bachelor's degree

View full job page →

Today

Senior Data Engineer (Databricks & Cloud Analytics)

CGI Group, Inc. Salt Lake City, UT

Salt Lake City, UT

Today

$80k - $139k/yr Full time Senior Azure Data Factory Azure Data Lake

Apply Now

Job Description

CGI Group, Inc. is seeking a Senior Data Engineer (Databricks & Cloud Analytics) to design, develop, and support secure, scalable, high-performing enterprise data platforms. This role is onsite in the Salt Lake City, UT area and focuses on building cloud data pipelines and analytics capabilities using Databricks, Apache Spark, and Azure services.

Compensation: USD 79,600 to 139,300 per year. Experience: 6+ years.

What you’ll be doing

Design, develop, test, deploy, and maintain enterprise data engineering solutions using modern cloud and big data technologies.
Build scalable ETL/ELT pipelines with Databricks, Apache Spark (PySpark), Delta Lake, and Azure Data Factory.
Create high-performance ingestion, transformation, and integration frameworks that support enterprise analytics and reporting.
Develop, optimize, and maintain complex SQL queries, stored procedures, and transformation processes.
Design scalable data models for business intelligence, analytics, and AI initiatives.
Integrate enterprise data exchange using RESTful APIs, event-driven architectures, and legacy SOAP services.
Develop and maintain streaming and messaging solutions using Apache Kafka.
Monitor, troubleshoot, and optimize production pipelines, performing root cause analysis and implementing long-term fixes.
Apply data quality, governance, security, and performance best practices across enterprise platforms.
Use Git and follow CI/CD and enterprise DevOps best practices.
Work with Solution Architects, Product Owners, Business Analysts, and cross-functional engineering teams to translate business needs into technical solutions.
Participate in Agile ceremonies, including sprint planning, backlog refinement, architecture discussions, code reviews, and retrospectives.
Create technical documentation, deployment artifacts, testing documentation, and operational runbooks.
Mentor junior engineers and contribute to engineering standards, best practices, and continuous improvement initiatives.

What you bring

Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related technical discipline (or equivalent professional experience).
6+ years designing, developing, and supporting enterprise data platforms, cloud analytics solutions, or large-scale data engineering initiatives.
Strong hands-on experience with Databricks.
Strong hands-on experience with Apache Spark (PySpark).
Strong hands-on experience with Python and SQL.
Strong hands-on experience with Scala.
Experience with Databricks Workspaces, Delta Lake, and Unity Catalog.
Experience with Delta Live Tables (DLT), Databricks SQL, MLflow, and Databricks Jobs.
Strong SQL development experience, including query optimization and performance tuning.
Experience designing and implementing ETL/ELT with Azure Data Factory (or comparable cloud integration platforms).
Experience with Apache Kafka (or other event streaming technologies).
Experience integrating enterprise applications using REST APIs, JSON, XML, and SOAP web services.
Experience with Azure Data Lake Storage (ADLS Gen2) (or comparable cloud storage platforms).
Experience using Git for source code management in collaborative development.
Experience working in Linux, including shell scripting and command-line utilities.
CI/CD experience using Azure DevOps, GitHub Actions, or similar DevOps platforms is preferred.
Terraform familiarity is preferred.
Strong analytical, troubleshooting, and problem-solving skills; ability to manage multiple priorities and work independently while mentoring teammates and contributing to technical leadership.
Experience in Agile environments using Scrum, Kanban, or SAFe methodologies.

Beneficial ways CGI supports you

Competitive compensation
Comprehensive insurance options
401(k) matching contributions and the share purchase plan
Paid time off for vacation, holidays, and sick time
Paid parental leave
Learning opportunities and tuition assistance
Wellness and well being programs

Collaboration and communication

Clearly communicate complex technical concepts to both technical and non-technical audiences.
Collaborate effectively with architects, developers, business analysts, product owners, and client stakeholders.
Build trusted relationships across cross-functional teams while delivering high-quality solutions.
Foster knowledge sharing, continuous learning, and engineering excellence.

View full job page →

1d ago

Data Engineer

Exodus Integrity Services (EIS) Broadview Heights, OH

Broadview Heights, OH

1d ago

$125k - $135k/yr Full time Azure Data Factory Azure Data Platform Azure Platform

Apply Now

Job Description

Exodus Integrity Services (EIS) is hiring an experienced Data Engineer for an onsite, full-time position in Broadview Heights, OH. In this role, you will build and support scalable data pipelines, Lakehouse environments, semantic models, and governed datasets that enable business intelligence and advanced analytics. You will also help connect disparate systems and deliver dependable integrations that maximize existing business investments.

What you’ll do

Build and maintain Fabric Lakehouses, Data Warehouses, and OneLake storage layers.
Develop Microsoft Fabric Data Pipelines using Data Factory for ingestion, transformation, orchestration, and automation.
Create and optimize Spark notebooks to support ETL/ELT workloads.
Implement medallion architecture within Fabric using bronze/silver/gold patterns.
Manage and monitor workloads using Fabric capacities, workspaces, and governance features.
Build and maintain semantic models so reporting teams can use consistent, governed data.
Collaborate with reporting developers using Power BI to support performant data models.
Optimize large-scale datasets for consumption and self-service analytics.
Design, build, and maintain scalable and reliable data pipelines.
Work with structured and unstructured data, including Delta Lake and parquet data lake formats.
Apply best practices for data quality, lineage, monitoring, and observability.
Improve performance using indexing, partitioning, caching, and data optimization.
Gather requirements with business stakeholders and contribute to data governance and metadata management practices.
Ensure enterprise data integrity and security on host computers and databases, and during data transfers, aligned with privacy, security, and compliance needs.
Research emerging products, services, protocols, and standards to support systems software procurement and development.
Develop, document, and maintain policies, procedures, and training plans related to system administration and appropriate use.
Provide guidance and act as escalation support to the Help Desk.
Recommend, schedule, and perform system improvements, upgrades, patches, reconfigurations, and/or purchases.

Requirements

College degree or equivalent experience in information technology.
Related industry certifications are expected.
Strong knowledge of API Integration & Development, including enterprise application integration and middleware technologies such as web services, databases, and application/content integration.
Experience with Microsoft Fabric (Data Factory, Lakehouse, Warehouse).
Familiarity with Azure Data Services (ADLS, Synapse, ADF, Databricks, etc.).
Strong SQL development expertise.
Experience with Microsoft SharePoint or similar collaboration tools.
A highly qualified candidate would be familiar with SharePoint Online, MS Power Automate, Power BI, Reporting Services, and Excel (Pivot Tables).
Experience documenting and maintaining configuration and process information.
Knowledge of applicable data privacy practices and laws.
Strong interpersonal, written, and oral communication skills.
Excellent time management and multitasking ability.
Highly self-motivated and directed, with strong attention to detail.
On-call availability after hours and weekends.
Reliable transportation and freedom to travel upon request (less than 10%).

Technologies

Microsoft Fabric
Azure
OneLake
Microsoft Data Factory
Spark notebooks
ETL, ELT
Delta Lake
parquet
Power BI
Microsoft SharePoint
SharePoint Online
MS Power Automate
Reporting Services
Excel (Pivot Tables)
API Integration
web services
Databases
ADLS
Synapse
ADF
Databricks
Power Automate
SQL

Compensation: USD 125,000 - 135,000 per year.

Schedule & location: Onsite in Broadview Heights, OH, full-time.

View full job page →

1d ago

Azure Data Engineer

AI Fire Remote 🌍 Remote

Remote

1d ago

Full time Analytics Azure Azure Data Factory

Apply Now

Job Description

AI Fire is building scalable data warehouse capabilities to support data-driven decision making, with an emphasis on reliable pipelines, standardized data, and efficient cloud infrastructure. In this role, you will design, develop, and maintain Azure-based data solutions, including migrating data from small business ERP platforms into its NetSuite ERP system.

What you’ll do

Design and implement efficient data pipelines using Azure Fabric, Data Factory, Databricks, and Synapse Analytics
Develop ETL/ELT processes to ingest, transform, and load large volumes of data
Create and maintain data models, Lakehouse architecture, and data warehousing solutions
Collaborate with business analysts and business stakeholders to understand data requirements
Monitor and optimize data workflows for performance and cost
Ensure data quality, security, and compliance with governance standards
Automate data validation and testing procedures
Build dashboards as needed in Power BI
Normalize and clean data

What you’ll need

Strong proficiency in Azure data services: Fabric, Data Factory, Databricks, Synapse, Logic Apps, Azure SQL, etc.
Experience with Python, SQL, Spark, or Scala
Experience with Workflow Definition Language (WDL)
Experience with Celigo
Solid understanding of cloud architecture and data lake principles
Familiarity with CI/CD tools and DevOps practices in Azure
Working knowledge of data governance, privacy, and security practices
Certification: Microsoft Certified Azure Data Engineer Associate
Understanding of general data in ERP systems
Experience with Power BI and Power Apps
Knowledge of machine learning workflows and integration
Analytical mindset and strong problem-solving and communication skills
Ability to work in a fast-paced, agile environment with strong teamwork
Experience with other platforms such as AWS data fabric (Redshift, Glue, Athena) or Databricks will also be considered
Bachelor’s degree in Computer Science, Engineering, or a related field

Technologies you’ll work with

Azure Fabric, Azure Data Factory, Databricks, Synapse Analytics
ETL/ELT, Lakehouse architecture
Power BI, Power Apps
Python, SQL, Spark, Scala
Workflow Definition Language (WDL), Celigo, Logic Apps, Azure SQL
CI/CD, DevOps practices in Azure
Machine learning workflows and integration
AWS data fabric (Redshift, Glue, Athena)
NetSuite ERP, ERP systems

Benefits

Competitive compensation
Pay on a weekly cycle, every Friday
Career Advancement Opportunities
Competitive benefits including healthcare, dental, vision, life insurance, paid time off, and holidays
Company paid short and long-term disability
Immediately vested 401(k) company match
Full-time employees participate in a Shared Ownership Program offering a monetary bonus aligned to the company’s long-term success
Exceptional guidance and support from managers
Collaborative culture and environment
Opportunity to work alongside talent in the fire protection industry

View full job page →

3d ago

Senior Data Analyst

SN Cloud Solutions Chicago, IL

Chicago, IL

3d ago

Full time Python Senior AWS

Apply Now

Job Description

SN Cloud Solutions is hiring a Senior Data Analyst to support analytics and reporting through modern data platforms and reliable data pipelines. This hybrid role in Chicago, IL (60619) focuses on working with large datasets, ETL/ELT workflows, and distributed processing, with a strong emphasis on Python and PySpark.

With 10+ years of experience, you will help translate business and technical needs into data solutions while collaborating across data engineering and analytics stakeholders. The role also includes troubleshooting pipelines, improving performance and scalability, and documenting data flows and transformation logic.

What you’ll do

Understand business and technical data requirements and translate them into practical data solutions.
Partner with teams working across databases, data lakes, and modern data fabric architectures.
Develop, maintain, and troubleshoot ETL/ELT data pipelines.
Work with structured and semi-structured data from multiple sources.
Use Python and PySpark to support data processing, transformation, and analysis.
Conduct data cleansing, transformation, validation, and data quality checks.
Optimize data processing jobs and pipelines for performance and scalability.
Collaborate with data engineers, analysts, and business stakeholders to deliver usable outputs.
Support data integration and migration activities.
Document data flows, transformation logic, and technical processes.

What you bring

Strong understanding of data analytics and data concepts.
10+ years of experience in data analytics, data engineering, data integration, or related data technologies.
Understanding of databases, data lakes, and data fabric.
Hands-on or strong conceptual knowledge of ETL/ELT processes and tools/packages.
Good knowledge of Python.
Good understanding of Apache PySpark and distributed data processing.
Understanding of data transformation, data quality, and data integration.
Strong SQL and database fundamentals.
Good analytical and problem-solving skills.

Technology areas you’ll work with

Python, PySpark (Apache PySpark)
ETL, ELT
SQL
Databricks
Azure Data Factory, Azure
Snowflake, Microsoft Fabric
AWS, GCP

Preferred qualifications

Experience with cloud data platforms such as Azure, AWS, or GCP.
Knowledge of modern data warehouse/lakehouse architectures.
Experience with tools such as Databricks, Azure Data Factory, Snowflake, Microsoft Fabric, or similar platforms.
Understanding of data governance and data quality concepts.
Experience working in Agile environments.

View full job page →

5d ago

Senior Data Engineer - AWS Data Platform (Redshift, Glue, and Airflow)

Versant Media Orlando, FL 🇺🇸 Remote

Orlando, FL

5d ago

Full time Backend Developer Senior 3d Design Tools

Apply Now

Job Description

Versant Media is hiring a Senior Data Engineer to design and deliver data pipelines and warehousing capabilities for analytics use cases.

Responsibilities

Design and implement data warehouse and data mart architectures to support presentation layers for elastic cubes, reporting, and analytics
Perform hands-on ETL/ELT development and share responsibility for monitoring data warehouse and data mart workloads
Develop and support data pipelines using Airflow and AWS Glue, with additional pipeline work in Azure Data Factory, Python, and Golang
Build and maintain schemas and structures that support analytical requirements
Deliver hands-on database work including T-SQL or PL/SQL development, query tuning, table development, stored procedures, and functions
Create and manage indexes to improve performance for operational workloads
Troubleshoot and resolve production data issues
Coordinate with business users and project managers to identify business problems and implement solutions
Apply technical knowledge to propose improvements for existing systems and new requirements
Work with other IT departments on systems communication processes
Participate in meetings with multiple IT groups, including other business unit IT teams and technical operations (Server Group and infrastructure groups), to address issues and concerns
Mentor other Data Engineers
Identify software solutions needed for new projects
Provide weekly reporting to management on project status and issues
Support on-call production requirements

Requirements

7+ years of data warehousing / OLAP experience
7+ years of multidimensional database architecture and design experience
5+ years of SQL experience
3+ years of Python experience
2+ years of Redshift experience
2+ years of NoSQL experience
Experience with team and vendor partner management
Clear understanding of principles and techniques of web development
Experience with AWS Glue and Airflow
Experience with API
Dimensional database architecture experience
Formal systems life cycle methodology experience

Technologies

tsql, psql
Airflow, AWS Glue
Azure Data factory
Python, Golang
Azure, AWS, GCP
Redshift

Desired Qualifications

Cloud Data Warehouse operations experience
Tableau, SSRS, big data, and Realtime BI experience
Experience with data streaming

Location and Work Mode

Orlando, FL (remote)
Fully remote: expected to contribute from a non-Versant worksite, most commonly an employee’s residence

View full job page →

9d ago

Lead AI Engineer

Vytwo Dallas, TX

Dallas, TX

9d ago

Full time Manager Artificial Intelligence Azure

Data Factory Azure Jobs

Get Data Factory Azure Jobs alerts