Azure Data Engineer
Big Data
Cloud Data Engineering
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Informatica
Information Technology (IT)
Integration
Programming
Programming Language
Programming Languages
Software Development
SQL
Job Description
Robotics Technologies is seeking an Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. The role focuses on ETL/ELT, analytics-ready warehousing, lake and lakehouse architectures, governance, and operational monitoring for batch and real-time processing.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure data services.
- Build and optimize ETL/ELT workflows using Azure Data Factory.
- Develop data processing solutions using Azure Databricks and PySpark.
- Work with Azure Synapse Analytics for data warehousing and analytical workloads.
- Create complex SQL queries and stored procedures, including performance optimization.
- Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
- Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
- Implement data quality, validation, transformation, and governance processes.
- Develop and maintain batch and real-time data processing solutions.
- Optimize pipelines for performance, scalability, and cost efficiency.
- Implement monitoring, logging, and error-handling mechanisms.
- Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
- Follow security best practices for data access, encryption, and compliance.
Requirements
- Cloud Platform: Microsoft Azure
- Data Integration: Azure Data Factory (ADF)
- Big Data: Azure Databricks, Apache Spark, PySpark
- Data Warehousing: Azure Synapse Analytics
- Storage: Azure Data Lake Storage Gen2
- Programming: Python, PySpark, SQL
- Databases: Azure SQL Database, SQL Server
- Data Architecture: Lakehouse, Delta Lake, Medallion Architecture
- DevOps: Azure DevOps, Git, CI/CD
- Data Governance: Microsoft Purview
- Streaming: Azure Event Hubs, Stream Analytics
Additional Details
Location: Raleigh, NC (onsite)
Compensation: USD 78 per hour
Core Technologies: Microsoft Azure, Azure Data Factory (ADF), Azure Databricks, Apache Spark, PySpark, Azure Synapse Analytics, Azure Data Lake Storage Gen2, Python, SQL, Azure SQL Database, SQL Server, Lakehouse, Delta Lake, Medallion Architecture, Azure DevOps, Git, CI/CD, Microsoft Purview, Azure Event Hubs, Stream Analytics