Databricks Data Engineer
Job Description
Deloitte's Databricks Data Engineer role is based onsite in Arlington, VA, within the Core AI & Data practice. The position centers on designing, building, and optimizing cloud-based data engineering solutions that leverage Databricks to support large-scale transformations, analytics, and AI initiatives. The salary range is USD 86,700 to 170,900 per year.
Responsibilities
- Design, build, and sustain data pipelines and engineering solutions using Databricks, Apache Spark, Python, and SQL.
- Support modernization of enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns.
- Develop and manage batch and streaming data workflows that support reporting, analytics, and AI use cases.
- Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance.
- Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs.
- Demonstrate the following skills expected for the role:
- Ability to work independently and as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
- 3+ years of experience in data engineering, ETL development, or data platform engineering
- 2+ years of experience building data pipelines in Databricks using Apache Spark, Python, and SQL
- Experience implementing data models, data integration patterns, and cloud-based data processing workflows
- Experience working with at least one cloud platform: AWS, Azure, or GCP
- Ability to travel 50% on average depending on client engagements
- Limited immigration sponsorship may be available
Technologies
- Databricks
- Apache Spark
- Python
- SQL
- Delta Lake
- Databricks Workflows
- Unity Catalog
- Git-based version control
- CI/CD pipelines
- AWS
- Azure
- GCP
Preferred
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Experience using Git-based version control and CI/CD pipelines
- Experience supporting batch and streaming data workloads
- Experience with data warehousing, lakehouse architecture, and performance optimization
- Experience supporting analytics or machine learning data pipelines
- Experience working in consulting or client service delivery environments
Accommodation Information
Information for applicants with a need for accommodation: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applic...