Lead Azure Data Engineer
Job Description
Robotics Technologies is seeking a Lead Azure Data Engineer to support a long-running data engineering engagement in Houston, TX (onsite). This role is focused on delivering production-ready analytics and data platform capabilities on Microsoft Azure, with a 10-month engagement plus extension.
The work includes building and improving data ingestion and transformation pipelines using Azure Data Factory and Azure Databricks, while also strengthening CI/CD practices across Azure environments. The position includes collaboration with stakeholders through testing and delivery activities as solutions are built and refined.
Responsibilities
- Develop Azure Data Factory pipelines, data flows, triggers, integration runtimes, and parameterized workflows.
- Build and optimize Azure Databricks notebooks, jobs, workflows, and Delta Lake solutions.
- Create modular data engineering code in Python or Scala using unit testing practices.
- Write and tune advanced SQL queries using CTEs, window functions, and large dataset patterns.
- Manage and optimize data storage with ADLS Gen2, Parquet, partitioning, Z-Ordering, OPTIMIZE, and VACUUM.
- Support Git-based CI/CD for promotion across Azure Data Factory and Azure Databricks environments.
- Collaborate with stakeholders and participate in testing and delivery activities.
Requirements
- 8-10 years of data engineering experience
- At least 3 years of Azure experience
- Experience with Azure Data Factory and Azure Databricks
- Strong advanced SQL skills
- Proficiency in Python or Scala
- Experience working with large datasets and optimizing data pipelines
Tech Stack
- Azure Data Factory, data flows, triggers, integration runtimes, parameterized workflows
- Azure Databricks, Delta Lake, Python, Scala
- SQL (CTEs, window functions)
- ADLS Gen2, Parquet, partitioning, Z-Ordering, OPTIMIZE, VACUUM
- Git-based CI/CD (CI/CD)
Location: Houston, TX (onsite)
Duration: 10 Months + Extension
Compensation: USD 63 per hour (C2C)
Employment Type: W-2, 1099, C2C
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Domain Exposure: Aerospace/ Airlines
Job ID: J55503