Delta Live Tables

Delta Live Tables Data Jobs

7 jobs found

Today

Sr Databricks Data Engineer

Deloitte New York, NY

New York, NY

Today

$116k - $229k/yr Full time Manager Big Data Bigdata

Apply Now

Job Description

Deloitte is seeking a Sr Databricks Data Engineer in New York, NY (onsite), with a salary range of USD 116,200 - 229,100 per year, to design and optimize cloud-based data engineering solutions on Databricks for analytics and AI use cases across enterprise data platforms.

Responsibilities

Define, document, and promote best-in-class approaches for data architecture, integration, and modelling.
Design, build, and maintain robust data pipelines and architectures that support large-scale enterprise data needs.
Initiate and manage efforts to improve data quality, operational efficiency, and process scalability.
Evaluate, pilot, and adopt new big data and analytics technologies; lead, coach, and develop teams of data engineers and architects to ensure project success.
Consult on and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems.
Explain technical concepts and business value to executives, business leads, and technology teams.
Oversee CI/CD practices and automation using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments and operations.

Requirements

Minimum 1 year of relevant experience
Bachelor's degree in Computer Science, Engineering, or a related field
Ability to work independently and as part of a team
Effective written and verbal communication skills
Meticulous attention to detail and quality of work
Ability to build and sustain professional relationships
Ability to lead projects or workstreams
Capability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
Strong interpersonal skills and professional demeanor
Ability to meet deadlines

Technologies

Databricks
Delta Lake
Apache Spark
PySpark
Delta Live Tables
Autoloader
Structured Streaming
Databricks Workflows
Unity Catalog
Apache Airflow
CI/CD pipelines
Azure DevOps
AWS Code Pipeline
Jenkins
TFS
PowerShell
AWS
Azure
GCP
Databricks Lakeflow

Benefits

Discretionary annual incentive program

The Team

Deloitte's Core AI & Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence capabilities across the business. The team works with clients to architect, engineer, and deploy cloud-based data solutions that improve decision-making, enable innovation, and support large-scale transformation. Practitioners collaborate across business and technology functions to solve complex challenges in data modernization.

Preferred qualifications

Master's degree in Computer Science, Engineering, or a related field
Experience in one or more AWS, Azure, and GCP cloud ecosystems and related big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

View full job page →

2d ago

Sr Databricks Data Engineer

Deloitte Dallas, TX

Dallas, TX

2d ago

$116k - $229k/yr Full time Apache Spark Azure Big Data

Apply Now

Job Description

Based in Dallas and operating on-site, this senior Databricks data engineering role sits at the heart of Deloitte’s AI & Data practice. You will design, build, and optimize cloud-native data solutions on Databricks to modernize platforms, unlock analytics, and enable AI use cases across enterprise environments. The position offers a salary range of USD 116,200 to 229,100 per year as you lead pipelines, governance, and DevOps initiatives while guiding teams through technical evolution.

Responsibilities

Establish and promote best-in-class approaches to data architecture, integration, and modelling.
Own the end-to-end design, development, and ongoing maintenance of robust data pipelines and architectures that support large-scale enterprise needs.
Drive efforts to raise data quality, improve operational efficiency, and scale data processes.
Evaluate, pilot, and integrate new big data and analytics technologies to keep the organization at the cutting edge.
Lead, coach, and develop teams of data engineers and architects to ensure successful project delivery.
Consult on and implement data governance, security, and compliance strategies tailored to modern cloud ecosystems.
Communicate complex technical concepts and business value to executives, business leaders, and technology teams.
Oversee DevOps and automation through CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell.

Requirements

Bachelor’s degree in Computer Science, Engineering, or a related field.
5+ years of hands-on data engineering experience with a focus on Databricks on AWS, Azure, or GCP.
Experience with Lakehouse architectures, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
Proficiency in data warehousing concepts (3NF), dimensional modelling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
1+ year leading complex, cross-functional data projects and technical teams, including exposure to Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance tuning for data pipelines, code, and compute resources.
Ability to travel 50% on average based on client engagements and industry projects.
Limited immigration sponsorship may be available.

Technologies

Databricks
AWS, Azure, GCP
Delta Lake, Apache Spark, PySpark
Delta Live Tables, Autoloader, Structured Streaming
Databricks Workflows, Apache Airflow, Unity Catalog
Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
Databricks Lakeflow

Benefits

Discretionary annual incentive program, subject to program rules and performance factors, including individual and organizational results.

The Team

Deloitte's Core AI & Data practice helps clients modernize data platforms, strengthen data foundations, and scale analytics and AI capabilities across the business. The team collaborates across business and technology functions to architect, engineer, and deploy cloud-based data solutions that support informed decision-making, innovation, and large-scale transformation.

View full job page →

4d ago

Sr Databricks Data Engineer

Deloitte Pittsburgh, PA

Pittsburgh, PA

4d ago

$116k - $229k/yr Full time Apache Airflow Automation Big Data

Apply Now

Job Description

Senior Databricks Data Engineer within Deloitte AI and Data practice, accountable for designing, building, and optimizing cloud-based data engineering solutions on Databricks to modernize data platforms, enable analytics and AI, and drive measurable business outcomes. This role is onsite in Pittsburgh, PA, with a salary range of USD 116,200 to 229,100 per year.

Responsibilities

Establish and advocate leading practices for data architecture, integration, and modeling, documenting standards and promoting adherence across teams.
Own the end-to-end design, development, and maintenance of robust data pipelines and architectures to support enterprise-scale data needs.
Lead initiatives to enhance data quality, streamline operations, and scale data processes.
Assess, pilot, and integrate new big data and analytics technologies to keep the organization at the cutting edge; provide leadership and mentorship to data engineers and architects to support growth and project success.
Advise on and implement governance, security, and compliance strategies tailored to cloud-based data ecosystems.
Translate technical concepts and business value for stakeholders across the organization, including executives, business leads, and technology teams.
Guide the adoption of CI/CD practices using tools such as Azure DevOps, AWS CodePipeline, Jenkins, TFS, and PowerShell to streamline deployments and operations.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field
More than five years of hands-on data engineering experience focusing on Databricks across AWS, Azure, or Google Cloud Platform (GCP)
Proficiency with Lakehouse architectures, Apache Spark, Delta Lake, cloud-native databases and storage solutions, and distributed compute platforms
Experience with data warehousing and 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
At least one year leading complex, cross-functional data projects and technical teams, including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data pipelines, code, and compute resources
Ability to travel approximately 50 percent, depending on client engagements
Limited immigration sponsorship may be available
Master's degree in Computer Science, Engineering, or a related field
Experience with one or more cloud ecosystems (AWS, Azure, GCP) and associated big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

Technologies

Databricks
Amazon Web Services (AWS)
Microsoft Azure
Google Cloud Platform (GCP)
Apache Spark
Delta Lake
Unity Catalog
Delta Live Tables
Autoloader
Structured Streaming
Databricks Workflows
Apache Airflow
Azure DevOps
AWS CodePipeline
Jenkins
TFS
PowerShell
PySpark
Databricks Lakeflow

Benefits

Discretionary annual incentive program
Benefits package aligned with Core Talent Model

Qualifications Required

Bachelor's degree in Computer Science, Engineering, or a related field
Five or more years of hands-on data engineering experience with a focus on Databricks on AWS, Azure, or GCP
Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
Experience with data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
At least one year leading complex, cross-functional data projects and technical teams, including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data pipelines, code, and compute resources
Ability to travel approximately 50 percent
Limited immigration sponsorship may be available

Preferred

Master's degree in Computer Science, Engineering, or a related field
Experience with one or more cloud ecosystems (AWS, Azure, GCP) and their big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

View full job page →

26d ago

Sr Databricks Data Engineer

Deloitte Sacramento, CA

Sacramento, CA

26d ago

$138k - $194k/yr Full time Autoloader Big Data Bigdata

Apply Now

Job Description

Deloitte is seeking a Sr Databricks Data Engineer to design, build, and optimize cloud-based data engineering solutions that modernize data platforms and enable analytics and AI at enterprise scale. This on-site role in Sacramento focuses on delivering robust data pipelines, governance strategies, and technical leadership to keep the organization at the forefront of cloud data engineering. The position offers a salary range of USD 137,500 to 193,600 per year.

Responsibilities

Develop and promote best-in-class approaches for data architecture, integration, and modelling; document standards and drive adoption across teams.
Lead the design, development, and maintenance of robust data pipelines and architectures that support large-scale, enterprise data needs.
Drive excellence by leading initiatives to improve data quality, operational efficiency, and process scalability.
Evaluate, pilot, and integrate new big data and analytics technologies, ensuring the organization remains at the cutting edge; lead, coach, and develop teams of data engineers and architects to ensure effective project delivery.
Advise on, design, and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems.
Explain technical concepts and business value to a range of stakeholders, including executives, business leads, and technology teams.
Oversee the implementation of CI/CD practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments and operations.
Provide clear guidance to colleagues and stakeholders to align efforts and ensure successful outcomes.

Requirements

Ability to work independently and collaboratively within a team environment.
Strong written and verbal communication skills.
Meticulous attention to detail and a commitment to high-quality work products.
Proven ability to build and sustain professional relationships.
Experience leading projects or workstreams.
Ability to manage and prioritize multiple tasks in a fast-paced, dynamic setting.
Strong interpersonal skills and a professional demeanor.
Ability to meet deadlines.

Technologies

Databricks
AWS
Azure
GCP
Delta Lake
Apache Spark
PySpark
Unity Catalog
Delta Live Tables
Autoloader
Structured Streaming
Databricks Workflows
Apache Airflow
Azure DevOps
AWS Code Pipeline
Jenkins
TFS
PowerShell
Databricks Lakeflow

Qualifications

Bachelor's degree in Computer Science, Engineering, or a related field.
5+ years of hands-on data engineering experience with a focus on Databricks on AWS, Azure, or GCP.
Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
Experience with data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
1+ year leading complex, cross-functional data projects and technical teams, including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data engineering pipelines, code, and compute resources.
Ability to travel 50% on average based on client engagement and project needs.
Limited immigration sponsorship may be available.

Preferred Qualifications

Master's degree in Computer Science, Engineering, or a related field.
Experience across one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services.
Experience tuning and optimizing performance in Databricks and Apache Spark environments.
Experience with Databricks Lakeflow.
Experience with artificial intelligence and machine learning solutions.

View full job page →

1mo ago

Sr Databricks Data Engineer

Deloitte Seattle, WA

Seattle, WA

1mo ago Closed

$138k - $194k/yr Full time Apache Airflow Automation Azure

This position is no longer accepting applications (closed Jul 22, 2026).

Job Description

Deloitte is seeking a Sr Databricks Data Engineer to design and deliver cloud-based data engineering solutions powered by Databricks, enabling analytics and AI at scale for enterprise clients. This onsite role in Seattle, WA, involves working with diverse stakeholders and may require up to 50% travel based on client needs. The position blends hands-on engineering with leadership across data architectures, governance, and modernization initiatives.

Responsibilities

Champion Best Practices: Define, document, and promote best-in-class approaches for data architecture, integration, and modelling.
Pipeline Ownership: Lead the design, development, and maintenance of robust data pipelines and architectures to support large-scale enterprise data needs.
Drive Excellence: Initiate and manage work to improve data quality, operational efficiency, and process scalability.
Team and Technology Lead: Evaluate, pilot, and integrate new big data and analytics technologies to keep the organization at the forefront.
Lead, coach, and develop teams of data engineers and architects, fostering technical growth and effective project delivery.
Data Governance: Advise on, design, and implement governance, security, and compliance strategies for modern cloud data ecosystems.
Communication: Convey technical concepts and business value to executives, business leads, and technology teams.
DevOps and Automation: Oversee CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.
Provide clear guidance to others to support project success and knowledge transfer.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field
5+ years of hands-on data engineering experience with a focus on Databricks on AWS, Azure, or GCP
Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
Experience with data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
1+ year leading complex, cross-functional data projects and technical teams, including familiarity with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data pipelines, code, and compute resources
Ability to travel 50%, depending on client work and engagements
Limited immigration sponsorship may be available
Master's degree in Computer Science, Engineering, or a related field
Experience in one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

Technologies

Databricks, Delta Lake, Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Unity Catalog
Apache Airflow
DevOps: Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
PySpark, Apache Spark
Databricks Lakeflow
AWS, Azure, GCP

Benefits

Discretionary annual incentive program
Core Talent Model benefits package
Reasonable accommodations for people with disabilities

The Team

Deloitte's Core AI & Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and AI capabilities across the business. The team collaborates with clients to architect, engineer, and deploy cloud-based data solutions that improve decision-making and support large-scale transformation, bridging business and technology to solve complex data modernization challenges.

View full job page →

1mo ago

Sr Databricks Data Engineer

Deloitte Nashville, TN

Nashville, TN

1mo ago Closed

$138k - $194k/yr Full time Analytics Azure Azure Data Lake Storage

This position is no longer accepting applications (closed Jul 19, 2026).

Job Description

Senior Databricks Data Engineer in Deloitte's AI and Data practice, onsite in Nashville, TN, with a salary range of USD 137,500 to 193,600 per year.

Responsibilities

Establish and promote leading practices for data architecture, integration, and modelling across projects
Own the end-to-end design, development, and ongoing maintenance of scalable data pipelines and architectures for enterprise data needs
Lead initiatives to improve data quality, operational efficiency, and scalability of data processes
Evaluate, pilot, and integrate emerging big data and analytics technologies; mentor and develop teams of data engineers and architects
Advise on and implement governance, security, and compliance strategies for cloud data ecosystems
Convey technical concepts and business value to executives, business leads, and technology teams
Oversee CI/CD implementations using Azure DevOps, AWS CodePipeline, Jenkins, TFS, and PowerShell to streamline deployments and operations
Provide clear technical guidance to teammates and stakeholders

Requirements

Ability to work independently and collaboratively within a team
Strong written and verbal communication skills
Keen attention to detail and commitment to high-quality deliverables
Ability to build and sustain professional relationships
Experience leading projects or workstreams
Ability to manage and prioritize multiple tasks in a fast-paced environment
Strong interpersonal skills and professional demeanor
Proven ability to meet deadlines
Bachelor's degree in Computer Science, Engineering, or a related field
5+ years of hands-on data engineering with a focus on Databricks on AWS, Azure, or GCP
Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
Experience with data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
1+ year leading complex, cross-functional data projects and technical teams, including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of pipelines, code, and compute resources
Ability to travel up to 50% on average
Limited immigration sponsorship may be available
Master's degree in Computer Science, Engineering, or a related field
Experience across AWS, Azure, and/or GCP cloud ecosystems and related big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

Technologies

Databricks platform and Databricks Lakeflow
Lakehouse architecture and Delta Lake
Apache Spark and PySpark
AWS, Microsoft Azure, and Google Cloud Platform (GCP) cloud ecosystems
Cloud-native databases, storage solutions, and distributed compute platforms
Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Unity Catalog
CI/CD tooling: Azure DevOps, AWS CodePipeline, Jenkins, TFS, PowerShell
Data warehousing and ETL concepts related to 3NF and dimensional modeling

Benefits

Discretionary annual incentive program

View full job page →

2mo ago

Reporting Developer III - Cloud Analytics Data Engineer

Gulfstream Aerospace Corporation Savannah, GA

Savannah, GA

2mo ago Closed

Full time Senior Analytics Auto Loader

This position is no longer accepting applications (closed Jun 7, 2026).

Job Description

This onsite Savannah, GA role focuses on enterprise reporting development and data analytics within Gulfstream's Enterprise Reporting team, using Azure Databricks or Microsoft Fabric to drive business insights.

Responsibilities

Engage stakeholders and technology users to identify, analyze, and document business requirements.
Ensure consistency of application processes and adherence to applicable policies, procedures, and standards.
Perform routine administration and system maintenance for reporting and data analytics applications and solutions.
Document, develop, test, deploy, and support reporting and data analytics development using a variety of technical tools aligned to business needs.
Lead briefings and participate in technical meetings for specific projects or activities.
Carry out other duties as assigned.
Experience with Agile development methodology and working on an agile team preferred.
Understand software development lifecycle (SDLC) methodologies.
Conduct testing, including design and execution of test cases.
Interpret data structures and create effective visualizations and reports that generate business value.
Design and deliver compelling presentation materials.
Lead and facilitate cross-functional meetings and teams.

Requirements

Minimum 3 years of experience with Azure Databricks or Python ETL pipelines.
Experience with medallion framework architecture and ingesting data from on-premise systems to either Azure Databricks or Microsoft Fabric.
Production-grade Python code experience for data ingestion, transformation, and export, including unit testing, building reusable frameworks, error handling, disaster recovery, and logging frameworks.

Technologies

Azure Databricks
Databricks
Microsoft Fabric
Python
Delta Live Tables
Databricks Workflows
Declarative Pipelines
Auto Loader
Unity Catalog
Databricks CLI
Azure Active Directory
Databricks Jobs UI
Azure DevOps
Terraform
Databricks Asset Bundles
Power BI
SQL Server
Oracle

Databricks skillset

Experience managing workspace configurations, user roles, and access controls using Unity Catalog, Databricks CLI, and Azure Active Directory integration.

Microsoft Fabric skillset

Understanding of Lakehouse and Warehouse architecture and security.
Ability to configure pipelines, pipeline coordination, and monitoring.
Experience with semantic modeling and Power BI.

Education and Experience

Bachelor's Degree in Information Technology, Computer Science, Engineering or a related field, or an equivalent mix of education and experience.
At least 6 years of relevant business or technical experience, including a minimum of 3 years in reporting, data analytics, or related development/deployment roles.
Master's Degree may offset one year of experience; PhD may offset two years.
Position purpose: a data and analytics development role within Gulfstream Business Technology for the Enterprise Reporting team, supporting the Gulfstream Enterprise Reporting applications, including requirements development, solution design, testing, deployment, and ongoing support.

Certifications

Databricks Certified Data Engineer Associate (preferred)
Microsoft Certified: Azure Data Engineer Associate (preferred)

Job details

Requisition Number: 230958
Category: Information Systems
Percentage of Travel: Up to 25%
Shift: First
Employment Type: Full-time
Posting End Date: 03/21/2026
#LI-HS1

View full job page →

Delta Live Tables Data Jobs

Sr Databricks Data Engineer

Sr Databricks Data Engineer

Sr Databricks Data Engineer

Sr Databricks Data Engineer

Sr Databricks Data Engineer

Sr Databricks Data Engineer

Reporting Developer III - Cloud Analytics Data Engineer

Get Delta Live Tables Data Jobs alerts