DataJobs.io
← Back to all jobs

Job Description

Robotics Technologies is seeking a Lead Azure Data Engineer to support a long-running data engineering engagement in Houston, TX (onsite). This role is focused on delivering production-ready analytics and data platform capabilities on Microsoft Azure, with a 10-month engagement plus extension.

The work includes building and improving data ingestion and transformation pipelines using Azure Data Factory and Azure Databricks, while also strengthening CI/CD practices across Azure environments. The position includes collaboration with stakeholders through testing and delivery activities as solutions are built and refined.

Responsibilities

  • Develop Azure Data Factory pipelines, data flows, triggers, integration runtimes, and parameterized workflows.
  • Build and optimize Azure Databricks notebooks, jobs, workflows, and Delta Lake solutions.
  • Create modular data engineering code in Python or Scala using unit testing practices.
  • Write and tune advanced SQL queries using CTEs, window functions, and large dataset patterns.
  • Manage and optimize data storage with ADLS Gen2, Parquet, partitioning, Z-Ordering, OPTIMIZE, and VACUUM.
  • Support Git-based CI/CD for promotion across Azure Data Factory and Azure Databricks environments.
  • Collaborate with stakeholders and participate in testing and delivery activities.

Requirements

  • 8-10 years of data engineering experience
  • At least 3 years of Azure experience
  • Experience with Azure Data Factory and Azure Databricks
  • Strong advanced SQL skills
  • Proficiency in Python or Scala
  • Experience working with large datasets and optimizing data pipelines

Tech Stack

  • Azure Data Factory, data flows, triggers, integration runtimes, parameterized workflows
  • Azure Databricks, Delta Lake, Python, Scala
  • SQL (CTEs, window functions)
  • ADLS Gen2, Parquet, partitioning, Z-Ordering, OPTIMIZE, VACUUM
  • Git-based CI/CD (CI/CD)

Location: Houston, TX (onsite)

Duration: 10 Months + Extension

Compensation: USD 63 per hour (C2C)

Employment Type: W-2, 1099, C2C

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Domain Exposure: Aerospace/ Airlines

Job ID: J55503

Similar Jobs