As a Sr Databricks Data Engineer within Deloitte’s AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions using Databricks and related technologies. This role includes leading enterprise-scale data transformations through strong pipeline ownership, governance, and DevOps-aligned automation.
Key Responsibilities
- Champion best practices by establishing, documenting, and promoting approaches for data architecture, integration, and modeling.
- Own data pipelines by overseeing the design, development, and ongoing maintenance of data pipelines and architectures built for large-scale enterprise data needs.
- Drive excellence through initiatives that improve data quality, operational efficiency, and process scalability.
- Lead teams and technology by evaluating, piloting, and integrating new big data and analytics technologies; coach and develop data engineering teams of engineers and architects to support delivery.
- Support data governance by consulting on, designing, and implementing governance, security, and compliance strategies for modern cloud data ecosystems.
- Communicate with stakeholders by explaining technical concepts and business value to executives, business leaders, and technology teams.
- Enable DevOps and automation by overseeing CI/CD implementation and streamlined deployments and operations using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell.
Required Qualifications
- Ability to work independently and collaborate within a team.
- Effective written and verbal communication skills.
- Meticulous attention to detail and quality of work product.
- Ability to build and sustain professional relationships.
- Ability to lead projects or workstreams.
- Ability to manage and prioritize multiple tasks in a fast-paced, dynamic environment.
- Strong interpersonal skills and professional demeanor.
- Ability to meet deadlines.
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of hands-on data engineering experience with a focus on Databricks on AWS, Microsoft Azure, or GCP.
- Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
- Experience with data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
- 1+ year leading complex, cross-functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data engineering pipelines, code, and compute resources.
- Ability to travel 50%, on average.
- Limited immigration sponsorship may be available.
Preferred Qualifications
- Master’s degree in Computer Science, Engineering, or a related field.
- Experience with one or more AWS, Azure, and GCP cloud ecosystems and associated big data services.
- Experience tuning and optimizing performance in Databricks and Apache Spark environments.
- Experience with Databricks Lakeflow.
- Experience with artificial intelligence and machine learning solutions.
Required Tools and Technologies
- Databricks, Lakehouse architecture, Apache Spark, Delta Lake
- Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP)
- Cloud-native databases, storage solutions, distributed compute platforms
- Data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, PySpark
- Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows
- Apache Airflow, Unity Catalog
- Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
- CI/CD
Location
Rosslyn, VA (onsite)
Compensation
The salary range for this role is USD 116,200 to 229,100 per year. This range takes into account a wide range of factors used to determine compensation decisions.
You may be eligible to participate in a discretionary annual incentive program, subject to program rules. Any award depends on individual and organizational performance.
Benefits Information
For the associated benefit package, please reference: USBenefitsJourneyC...
Accommodation Notice
Deloitte is committed to providing reasonable accommodations for people with disabilities. If you require an accommodation to participate in the recruiting process, contact the Global Call Center (GCC) at USTalentCICInbox@deloitte.com.
Accommodation information for applicants is available here: join-deloitte-assistance-for-disabled-applic...
