Databricks Engineer - Data Engineer II
Backend Developer
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
ETL
Informatica
Information Technology (IT)
Pyspark
Software Development
Spark
SQL
Job Description
Join Deloitte’s AI & Engineering team as a Databricks Engineer II, focused on building and improving data pipelines on the Databricks Lakehouse platform. In this onsite role in Washington, DC, you will apply Medallion architecture patterns, strengthen data governance with Unity Catalog security controls, and support reliable Databricks workflows through testing and CI/CD.
Location: Washington, DC (onsite)
Compensation: USD 97,700 - 162,800 per year
Experience: 2+ years
Education: Bachelor’s degree
What you will do
- Develop and optimize data pipelines using Python, PySpark, and SQL on the Databricks Lakehouse platform
- Use Medallion architecture to organize, transform, and manage data across data layers
- Perform performance tuning for Databricks workloads and SQL queries
- Configure row-level and column-level security, and manage data lineage and data sharing in Unity Catalog
- Implement CI/CD and testing processes for Databricks workflows
What you bring
- Bachelor’s degree
- Ability to obtain and maintain the required clearance for this role
- 2+ years of Databricks engineering experience
- 2+ years of experience with Python, PySpark, and SQL
- Ability to travel 10-15% on average based on work, clients, and industries/sectors served
- Must be legally authorized to work in the United States without employer sponsorship, now or in the future
Technologies
- Python
- PySpark
- SQL
- Databricks Lakehouse platform
- Unity Catalog
Skills a successful candidate will demonstrate
- Ability to work independently and collaborate within a team
- Effective written and verbal communication skills
- Meticulous attention to detail and focus on work quality
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
Preferred qualifications
- Experience using Medallion architecture on the Databricks Lakehouse platform
- Experience configuring row-level and column-level security, data lineage, and data sharing in Unity Catalog
- Experience implementing CI/CD and testing processes for Databricks
- Experience with performance tuning in Databricks
Similar Jobs