Databricks Data Engineer
Azure Data Engineer
Big Data
Bigdata
Cdc
Change Data Capture
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Governance
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Databricks
Databricks Spark
Databricks Workflows
ETL
Event Driven Architecture
Informatica
Kafka
Lead Data Engineering
Pyspark
Scd Type 2
Spark
SQL
Streaming Data
Job Description
Robotics Technologies is hiring a Databricks Data Engineer to support the Retail Spine initiative. This onsite role in Phoenix, AZ focuses on building and optimizing scalable data solutions in a fast-paced, Azure-based environment, with hands-on ownership of Databricks and PySpark ETL/ELT, including CDC and Kafka streaming. The position is designed for engineers who can contribute from day one while improving existing pipelines alongside creating new ones.
What you’ll do
- Design, build, and optimize end-to-end ETL/ELT pipelines using Databricks and Apache Spark (PySpark).
- Develop and maintain scalable data solutions on Microsoft Azure, leveraging Databricks, Delta Lake, and Kafka streaming.
- Build robust pipelines with Change Data Capture (CDC) to support incremental processing and real-time or near real-time needs.
- Work on both new pipeline development and enhancements to existing workflows, quickly ramping on current codebases to deliver improvements.
- Integrate and process data from a wide range of sources, including Flat files, XML, JSON, SQL Server/JDBC systems, Kafka topics, APIs, MQ, and Unity Catalog volumes and other enterprise platforms.
- Implement data quality frameworks by writing technical data quality rules and quarantining error records.
- Apply canonical data modeling techniques, including SCD Type 1 and SCD Type 2 implementations.
- Ensure reliability, performance, scalability, and monitoring across all data workflows.
- Automate workflows using Databricks Workflows and CI/CD pipelines (GitHub), emphasizing reuse, efficiency, and standardization.
- Collaborate with developers, architects, and product owners, coordinating with stakeholders, source teams, and downstream consumers.
- Participate in Agile/Scrum ceremonies and deliver high-quality solutions within defined timelines.
What you bring
- Extensive hands-on Databricks experience with the ability to contribute from day one.
- Proven experience building end-to-end data engineering pipelines with CDC capabilities.
- Strong proficiency in PySpark and SQL (required); Python experience is a plus.
- Experience working in Microsoft Azure cloud environments.
Role details
- Location: Phoenix, AZ (onsite)
- Duration: 9 Months + Extension
- Employment type: W-2, 1099, C2C
- Salary/Bill rate: USD 71 - 71 per hourly (C2C: $71/hour)
- Job ID: J55801
- Domain exposure: Consumer Staples
- Work authorization: US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other; USC, GC, H-1B, OPT-EAD, GC-EAD, H4-EAD