Deloitte is seeking a Sr Databricks Data Engineer in New York, NY (onsite), with a salary range of USD 116,200 - 229,100 per year, to design and optimize cloud-based data engineering solutions on Databricks for analytics and AI use cases across enterprise data platforms.

Responsibilities

Define, document, and promote best-in-class approaches for data architecture, integration, and modelling.
Design, build, and maintain robust data pipelines and architectures that support large-scale enterprise data needs.
Initiate and manage efforts to improve data quality, operational efficiency, and process scalability.
Evaluate, pilot, and adopt new big data and analytics technologies; lead, coach, and develop teams of data engineers and architects to ensure project success.
Consult on and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems.
Explain technical concepts and business value to executives, business leads, and technology teams.
Oversee CI/CD practices and automation using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments and operations.

Requirements

Minimum 1 year of relevant experience
Bachelor's degree in Computer Science, Engineering, or a related field
Ability to work independently and as part of a team
Effective written and verbal communication skills
Meticulous attention to detail and quality of work
Ability to build and sustain professional relationships
Ability to lead projects or workstreams
Capability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
Strong interpersonal skills and professional demeanor
Ability to meet deadlines

Technologies

Databricks
Delta Lake
Apache Spark
PySpark
Delta Live Tables
Autoloader
Structured Streaming
Databricks Workflows
Unity Catalog
Apache Airflow
CI/CD pipelines
Azure DevOps
AWS Code Pipeline
Jenkins
TFS
PowerShell
AWS
Azure
GCP
Databricks Lakeflow

Benefits

Discretionary annual incentive program

The Team

Deloitte's Core AI & Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence capabilities across the business. The team works with clients to architect, engineer, and deploy cloud-based data solutions that improve decision-making, enable innovation, and support large-scale transformation. Practitioners collaborate across business and technology functions to solve complex challenges in data modernization.

Preferred qualifications

Master's degree in Computer Science, Engineering, or a related field
Experience in one or more AWS, Azure, and GCP cloud ecosystems and related big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

Sr Databricks Data Engineer