Databricks Data Engineer
Azure
Azure Databricks
Big Data
CI/CD
Cloud
Cloud Platforms
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Database
Databricks
Databricks Workflows
Delta Lake
Engineer
ETL
Git
Google Cloud
Pyspark
Software Development
Spark
SQL
Job Description
Deloitte seeks a Databricks Data Engineer to design, build, and optimize cloud-based data platforms for large-scale analytics and AI initiatives in an onsite role in McLean, VA, with a salary range of USD 86,700 to 170,900 per year.
Responsibilities
- Architect and implement data pipelines and engineering solutions using Databricks, Apache Spark, Python, and SQL.
- Support modernization of enterprise data platforms by deploying cloud-centric ingestion, transformation, and storage patterns.
- Develop and sustain batch and streaming data workflows to power reporting, analytics, and AI use cases.
- Apply data architecture, integration, and modeling practices to improve data quality, scalability, and platform performance.
- Collaborate with client teams and Deloitte colleagues to troubleshoot issues, implement enhancements, and support the delivery of large-scale data transformation programs.
- Lead projects or workstreams and coordinate across teams to meet objectives.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics.
- 3+ years of experience in data engineering, ETL development, or data platform engineering.
- 2+ years of experience building data pipelines in Databricks using Apache Spark, Python, and SQL.
- Experience implementing data models, data integration patterns, and cloud-based data processing workflows.
- Experience with at least one cloud platform: AWS, Azure, or GCP.
- Ability to travel approximately 50 percent based on client engagements and industries served.
- Limited immigration sponsorship may be available.
- Minimum 2 years of overall experience.
- Ability to work independently as well as in a team environment.
- Effective written and verbal communication skills.
- Meticulous attention to detail and commitment to quality.
- Ability to build and sustain professional relationships.
- Ability to lead projects or workstreams.
- Ability to manage and prioritize multiple tasks in a fast-paced, dynamic environment.
- Strong interpersonal skills and professional demeanor.
- Ability to meet deadlines and provide clear guidance to others.
Technologies
- Databricks
- Apache Spark
- Python
- SQL
- AWS
- Microsoft Azure
- Google Cloud Platform (GCP)
- Delta Lake
- Databricks Workflows
- Unity Catalog
- Git
- CI/CD pipelines
Preferred qualifications
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Experience using Git-based version control and CI/CD pipelines
- Experience supporting batch and streaming data workloads
- Experience with data warehousing, lakehouse architecture, and performance optimization
- Experience supporting analytics or machine learning data pipelines
- Experience working in consulting or client service delivery environments