Data Engineer – Databricks & ADF (ETL)
Big Data
Data
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Informatica
Information Technology (IT)
Programming
Programming Language
Programming Languages
Software Development
SQL
Job Description
The Data Engineer role at Robotics Technologies is centered on designing, building, and optimizing ETL and ELT workflows using Azure Data Factory (ADF) and Databricks. The position also includes SQL development and large-scale processing with PySpark or Python to support reliable data movement into data lakes and data warehouses.
Key Responsibilities
- Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
- Use Databricks for data processing, transformation, and related pipeline activities.
- Write and optimize SQL queries for data extraction and transformation.
- Perform large-scale data processing with PySpark or Python.
- Integrate data from multiple sources into data warehouses or data lakes.
- Monitor, troubleshoot, and optimize data pipelines to support stable operations.
- Collaborate with other teams to support data quality and reliability.
Required Qualifications
- Experience working with Databricks and Azure Data Factory (ADF).
- Strong understanding of ETL/ELT concepts.
- Good knowledge of SQL and data transformations.
- Basic experience with Python or PySpark.
- Understanding of Azure cloud services and data lake concepts.
Technology Stack
- Databricks
- Azure Data Factory (ADF)
- ETL, ELT
- SQL
- PySpark, Python
- Azure cloud services
- Data lake
Location and Compensation
This is an onsite role in Dallas, TX. Compensation is listed as USD 78 per hour.