Apache Spark

Apache Spark Data Jobs

2 jobs found

1d ago

Sr Databricks Data Engineer

Deloitte Dallas, TX

Dallas, TX

1d ago

$116k - $229k/yr Full time Apache Spark Azure Big Data

Apply Now

Job Description

Based in Dallas and operating on-site, this senior Databricks data engineering role sits at the heart of Deloitte’s AI & Data practice. You will design, build, and optimize cloud-native data solutions on Databricks to modernize platforms, unlock analytics, and enable AI use cases across enterprise environments. The position offers a salary range of USD 116,200 to 229,100 per year as you lead pipelines, governance, and DevOps initiatives while guiding teams through technical evolution.

Responsibilities

Establish and promote best-in-class approaches to data architecture, integration, and modelling.
Own the end-to-end design, development, and ongoing maintenance of robust data pipelines and architectures that support large-scale enterprise needs.
Drive efforts to raise data quality, improve operational efficiency, and scale data processes.
Evaluate, pilot, and integrate new big data and analytics technologies to keep the organization at the cutting edge.
Lead, coach, and develop teams of data engineers and architects to ensure successful project delivery.
Consult on and implement data governance, security, and compliance strategies tailored to modern cloud ecosystems.
Communicate complex technical concepts and business value to executives, business leaders, and technology teams.
Oversee DevOps and automation through CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell.

Requirements

Bachelor’s degree in Computer Science, Engineering, or a related field.
5+ years of hands-on data engineering experience with a focus on Databricks on AWS, Azure, or GCP.
Experience with Lakehouse architectures, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
Proficiency in data warehousing concepts (3NF), dimensional modelling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
1+ year leading complex, cross-functional data projects and technical teams, including exposure to Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance tuning for data pipelines, code, and compute resources.
Ability to travel 50% on average based on client engagements and industry projects.
Limited immigration sponsorship may be available.

Technologies

Databricks
AWS, Azure, GCP
Delta Lake, Apache Spark, PySpark
Delta Live Tables, Autoloader, Structured Streaming
Databricks Workflows, Apache Airflow, Unity Catalog
Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
Databricks Lakeflow

Benefits

Discretionary annual incentive program, subject to program rules and performance factors, including individual and organizational results.

The Team

Deloitte's Core AI & Data practice helps clients modernize data platforms, strengthen data foundations, and scale analytics and AI capabilities across the business. The team collaborates across business and technology functions to architect, engineer, and deploy cloud-based data solutions that support informed decision-making, innovation, and large-scale transformation.

View full job page →

1mo ago

Senior Software Engineer - Data & Analytics- Contingent

Experis Charlotte, NC

Charlotte, NC

1mo ago Closed

$76 - $76/hr Contract Senior Apache Spark Bash Scripting

This position is no longer accepting applications (closed Jun 27, 2026).