DataJobs.io
← Back to all jobs

Job Description

Robotics Technologies is seeking an Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. The role focuses on ETL/ELT, analytics-ready warehousing, lake and lakehouse architectures, governance, and operational monitoring for batch and real-time processing.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytical workloads.
  • Create complex SQL queries and stored procedures, including performance optimization.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize pipelines for performance, scalability, and cost efficiency.
  • Implement monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.

Requirements

  • Cloud Platform: Microsoft Azure
  • Data Integration: Azure Data Factory (ADF)
  • Big Data: Azure Databricks, Apache Spark, PySpark
  • Data Warehousing: Azure Synapse Analytics
  • Storage: Azure Data Lake Storage Gen2
  • Programming: Python, PySpark, SQL
  • Databases: Azure SQL Database, SQL Server
  • Data Architecture: Lakehouse, Delta Lake, Medallion Architecture
  • DevOps: Azure DevOps, Git, CI/CD
  • Data Governance: Microsoft Purview
  • Streaming: Azure Event Hubs, Stream Analytics

Additional Details

Location: Raleigh, NC (onsite)

Compensation: USD 78 per hour

Core Technologies: Microsoft Azure, Azure Data Factory (ADF), Azure Databricks, Apache Spark, PySpark, Azure Synapse Analytics, Azure Data Lake Storage Gen2, Python, SQL, Azure SQL Database, SQL Server, Lakehouse, Delta Lake, Medallion Architecture, Azure DevOps, Git, CI/CD, Microsoft Purview, Azure Event Hubs, Stream Analytics

Similar Jobs