Join Deloitte's AI & Data practice on a on-site basis in Kansas City, MO, and access a benefits-forward environment that prioritizes growth, collaboration, and impact. The Senior Databricks Data Engineer role offers a competitive salary range of USD 137,500 to 193,600 per year, with a discretionary annual incentive program. You will design, build, and optimize cloud-based data engineering solutions on Databricks to modernize data platforms, enable analytics and AI use cases, and drive data-driven decision making.
Responsibilities
- Define and promote best practices for data architecture, integration, and modelling to establish scalable standards across projects.
- Own data pipelines and architectures to support large-scale, enterprise data needs, from design through maintenance.
- Pursue data quality and efficiency by initiating efforts that improve data quality, operational efficiency, and process scalability.
- Lead teams and technology choices by evaluating, piloting, and integrating new big data and analytics technologies; coach and develop data engineers and architects to strengthen delivery capabilities.
- Governance and security by advising on and implementing governance, security, and compliance strategies for modern cloud data ecosystems.
- Bridge technical and business value by communicating concepts and benefits to executives, business leads, and technology teams.
- DevOps and automation by guiding CI/CD implementations with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.
- Provide clear guidance to peers and stakeholders to ensure alignment and effective execution.
Requirements
- Ability to work independently and as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and high-quality output
- Proven ability to build and sustain professional relationships
- Experience leading projects or workstreams
- Capacity to manage and prioritize multiple tasks in a fast-paced environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Bachelor's degree in Computer Science, Engineering, or related field
- 5+ years of hands-on data engineering experience focusing on Databricks across AWS, Azure, or GCP
- Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
- Experience with data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
- 1+ year leading complex cross-functional data projects and technical teams, including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and optimization of data pipelines and compute resources
- Ability to travel around 50% on average based on client engagements
- Limited immigration sponsorship may be available
Technologies
- Databricks, AWS, Microsoft Azure, Google Cloud Platform (GCP)
- Lakehouse architecture, Apache Spark, Delta Lake
- PySpark, Delta Live Tables, Autoloader, Structured Streaming
- Databricks Workflows, Apache Airflow, Unity Catalog, Databricks Lakeflow
- Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
Benefits
- Discretionary annual incentive program
Salary and designation details
Salary range for this role is USD 137,500 to 193,600 per year. The range reflects a variety of factors including skill sets, experience, certifications, and business needs. The disclosed range has not been adjusted for geographic differences related to the location of the position.
Accommodation
Information for applicants with a need for accommodation is available at Deloitte's career resources page: Information for applicants with a need for accommodation.
