Sr Databricks Data Engineer

Senior Databricks Data Engineer at Deloitte in Charlotte, NC, onsite, focusing on building and optimizing cloud-based data engineering solutions with Databricks across AWS, Azure, and GCP.

Job Details

• Location: Charlotte, NC (onsite)
• Salary: USD 137,500 - 193,600 per year
• Experience: 1+ years minimum
• Education: Bachelor's degree required; Master's degree preferred

Responsibilities

• Define and promote best-in-class data architecture, integration, and modeling practices.
• Own the design, development, and maintenance of robust data pipelines and architectures for large-scale enterprise needs.
• Lead efforts to improve data quality, operational efficiency, and scalability of data processes.
• Evaluate, pilot, and integrate new big data and analytics technologies; mentor and develop teams of data engineers and architects.
• Design and implement data governance, security, and compliance strategies for modern cloud data ecosystems.
• Communicate technical concepts and business value to executives, business leads, and technology teams.
• Oversee CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.
• Provide clear guidance to colleagues and project teams to drive successful outcomes.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field
• 5+ years of hands-on data engineering experience with a focus on Databricks on AWS, Azure, or GCP
• Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
• Experience with data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
• 1+ year leading complex, cross-functional data projects and technical teams; experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data engineering pipelines, code, and compute resources
• Ability to travel approximately 50% on average based on client engagements
• Limited immigration sponsorship may be available
• Master’s degree in Computer Science, Engineering, or a related field
• Experience in one or more cloud ecosystems (AWS, Azure, GCP) and associated big data services
• Experience tuning and optimizing performance in Databricks and Apache Spark environments
• Experience with Databricks Lakeflow
• Experience with artificial intelligence and machine learning solutions

Technologies

• Databricks
• AWS
• Microsoft Azure
• Google Cloud Platform (GCP)
• Lakehouse architecture
• Apache Spark
• Delta Lake
• PySpark
• Delta Live Tables
• Autoloader
• Structured Streaming
• Databricks Workflows
• Apache Airflow
• Unity Catalog
• CI/CD pipelines
• Azure DevOps
• AWS Code Pipeline
• Jenkins
• TFS
• PowerShell
• Databricks Lakeflow

The Team

Deloitte's Core AI and Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence capabilities across the business. The team collaborates to architect, engineer, and deploy cloud-based data solutions that improve decision making, enable innovation, and support large-scale transformation. Practitioners work across business and technology functions to solve complex challenges in data modernization.