Databricks Engineer - Data Engineer III
Azure Databricks
Big Data
Bigdata
CI/CD
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Integration Tools
Data Lakehouse
Data Lineage
Data Management
Data Modeling
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
Databricks Pyspark
DevOps
Devops Tools
ETL
Informatica
Information Technology (IT)
Row/column Security
Software Development
Software Engineering
Spark
SQL
Job Description
Deloitte’s AI & Engineering team is seeking a Databricks Engineer to build reliable, high-performing data capabilities on the Databricks Lakehouse platform. This onsite role in Washington, DC focuses on developing and optimizing data pipelines, strengthening governance, and improving performance with Databricks and SQL-related engineering practices.
Compensation: USD 107,700 - 179,500 per year. Minimum experience: 2+ years. Education: Bachelor’s degree.
What you’ll do
- Develop and optimize data pipelines using Python, PySpark, and SQL on the Databricks Lakehouse platform
- Use Medallion architecture patterns to organize, transform, and manage data across data layers
- Conduct performance tuning for Databricks workloads and SQL queries
- Configure row-level and column-level security and manage data lineage and data sharing in Unity Catalog
- Implement CI/CD and testing processes for Databricks workflows
What you bring
- Bachelor’s degree
- Ability to obtain and maintain the required clearance for this role
- 2+ years of Databricks engineering experience
- 4+ years of experience with Python, PySpark, and SQL
- Ability to travel 10-15%, on average, based on the work you do and the clients and industries/sectors served
- Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future
Additional skills that support success
- Work independently and collaborate effectively as part of a team
- Strong written and verbal communication skills
- Meticulous attention to detail and a focus on quality
- Ability to build and sustain professional relationships
- Capability to lead projects or workstreams
- Strong ability to manage and prioritize multiple tasks in a fast-paced environment
- Interpersonal skills and professional demeanor
- Ability to meet deadlines
- Provide clear guidance to others
Preferred experience
- Experience using Medallion architecture in the Databricks Lakehouse platform
- Experience configuring row-level and column-level security, data lineage, and data sharing in Unity Catalog
- Experience implementing CI/CD and testing processes for Databricks
- Experience with performance tuning in Databricks
Technologies: Python, PySpark, SQL, Databricks Lakehouse, Medallion architecture, Unity Catalog, CI/CD