Data Engineer
Backend Developer
Analytics
Automation Developer
Azure
Azure Data Factory
Azure Data Platform
Azure Platform
Azure Synapse Analytics
Big Data
Bigdata
Business Analytics
Business Intelligence
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Analytics Tools
Data Architecture
Data Engineer
Data Engineering
Data Factory
Data Factory Azure
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Visualization
Data Warehouse
Database
Databases
Databricks
Delta Lake
Design
Digital Marketing
Engineer
ETL
Hr Technology
Informatica
Information Technology (IT)
Integration
Microsoft
Microsoft Azure
Microsoft Fabric
Microsoft Office
Microsoft Power Platform
Power BI
Power Platform
Programming Language
Programming Languages
Pyspark
Reporting and Analytics
Software Development
Spark
SQL
Job Description
Aptean is hiring a hands-on Data Engineer to build and maintain scalable ingestion and transformation pipelines on Microsoft Fabric.
Responsibilities
- Design, build, and maintain data ingestion pipelines using Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks) and Azure Data Factory
- Create Python and PySpark notebooks to cleanse, transform, and enrich data across medallion architecture layers
- Implement Delta Lake patterns including partitioning, schema evolution, and incremental loads
- Apply data quality checks such as null handling, duplicate detection, schema validation, and SCD logic
- Build reusable metadata-driven and parameterized pipeline frameworks
- Troubleshoot pipeline failures, performance issues, and data discrepancies; perform root-cause analysis
- Participate in code reviews, testing, and CI/CD using Git-based workflows
- Support gold-layer datasets and semantic models for Power BI consumption
- Monitor pipelines and resolve operational issues within defined SLAs; support on-call rotations as needed
- Maintain technical documentation including data dictionaries, mappings, and runbooks
- Collaborate cross-functionally to deliver high-quality data engineering solutions
Requirements
- 3–5 years of experience building data pipelines in production or near-production environments
- Hands-on experience with Python and PySpark
- Experience with Azure Data Factory (or similar orchestration tools)
- Familiarity with Microsoft Fabric (or strong experience with Azure Synapse/Databricks with willingness to learn Fabric)
- Solid understanding of SQL, data modeling, and performance optimization
- Knowledge of medallion architecture and Delta Lake concepts
- Experience implementing data quality checks and basic SCD handling
- Familiarity with Git, branching, and CI/CD practices (including Azure DevOps or GitHub Actions)
- Exposure to Power BI and semantic data models is a plus
- Understanding of data governance concepts such as schema versioning and access controls preferred
- Strong problem-solving skills, attention to detail, and an ownership mindset
- Effective communication skills and ability to collaborate with technical and business teams
Technologies
- Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks)
- Azure, Azure Data Factory, Azure Synapse, Databricks
- Python, PySpark
- Delta Lake
- Power BI
- SQL
- Git, Azure DevOps, GitHub Actions
Benefits
- Work with modern data technologies including Microsoft Fabric and Azure
- Collaborative environment with experienced data engineering professionals
- Exposure to enterprise-level data, analytics, and AI initiatives
- Growth opportunities through hands-on learning and ownership of impactful projects
Location
- Alpharetta, GA (onsite)
Work Authorization
Candidates must be authorized to work in the United States without current sponsorship. Aptean is unable to sponsor work authorization at this time.
Similar Jobs
