Sr Databricks Data Engineer
Job Description
Deloitte is seeking a Sr Databricks Data Engineer to design and deliver cloud-based data engineering solutions powered by Databricks, enabling analytics and AI at scale for enterprise clients. This onsite role in Seattle, WA, involves working with diverse stakeholders and may require up to 50% travel based on client needs. The position blends hands-on engineering with leadership across data architectures, governance, and modernization initiatives.
Responsibilities
- Champion Best Practices: Define, document, and promote best-in-class approaches for data architecture, integration, and modelling.
- Pipeline Ownership: Lead the design, development, and maintenance of robust data pipelines and architectures to support large-scale enterprise data needs.
- Drive Excellence: Initiate and manage work to improve data quality, operational efficiency, and process scalability.
- Team and Technology Lead: Evaluate, pilot, and integrate new big data and analytics technologies to keep the organization at the forefront.
- Lead, coach, and develop teams of data engineers and architects, fostering technical growth and effective project delivery.
- Data Governance: Advise on, design, and implement governance, security, and compliance strategies for modern cloud data ecosystems.
- Communication: Convey technical concepts and business value to executives, business leads, and technology teams.
- DevOps and Automation: Oversee CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.
- Provide clear guidance to others to support project success and knowledge transfer.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field
- 5+ years of hands-on data engineering experience with a focus on Databricks on AWS, Azure, or GCP
- Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
- Experience with data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
- 1+ year leading complex, cross-functional data projects and technical teams, including familiarity with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data pipelines, code, and compute resources
- Ability to travel 50%, depending on client work and engagements
- Limited immigration sponsorship may be available
- Master's degree in Computer Science, Engineering, or a related field
- Experience in one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services
- Experience tuning and optimizing performance in Databricks and Apache Spark environments
- Experience with Databricks Lakeflow
- Experience with artificial intelligence and machine learning solutions
Technologies
- Databricks, Delta Lake, Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Unity Catalog
- Apache Airflow
- DevOps: Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
- PySpark, Apache Spark
- Databricks Lakeflow
- AWS, Azure, GCP
Benefits
- Discretionary annual incentive program
- Core Talent Model benefits package
- Reasonable accommodations for people with disabilities
The Team
Deloitte's Core AI & Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and AI capabilities across the business. The team collaborates with clients to architect, engineer, and deploy cloud-based data solutions that improve decision-making and support large-scale transformation, bridging business and technology to solve complex data modernization challenges.