Lead Data Engineer
Manager
Big Data
Bigdata
Cloud
Cloud Native
Cloud Platform
Cloud Platforms
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Science
Data Security
Data Warehouse
Database
Databases
Databricks
Databricks Workflows
Delta Lake
ETL
Google Cloud
Machine Learning
Programming Languages
Pyspark
Spark
SQL
Technical Lead
Job Description
Lead Data Engineer focusing on Databricks to design, build, and deliver modern data and analytics solutions for clients, leading delivery teams and advising stakeholders.
Responsibilities
- Lead the end-to-end design and delivery of Databricks based data and analytics solutions for client projects.
- Coordinate project teams and workstreams through requirements gathering, design, development, testing, and deployment phases.
- Convert business and technical needs into scalable data pipelines, data models, and platform capabilities.
- Provide guidance to client stakeholders on architecture, implementation approaches, and operating model considerations for modern data platforms.
- Oversee solution quality, resolve issues, manage delivery progress, and support project economics and schedule adherence.
Requirements
- Bachelor's degree.
- At least 6 years of experience delivering data engineering, analytics, or cloud data platform solutions.
- 3+ years of hands-on experience with Databricks and Apache Spark.
- 3+ years of Python and SQL experience.
- 2+ years of leading project teams or workstreams.
- Ability to travel on average about 50%, depending on client engagements.
- Limited immigration sponsorship may be available.
Technologies
- Databricks
- Apache Spark
- Python
- SQL
- Delta Lake
- Unity Catalog
- MLflow
- AWS
- Microsoft Azure
- Google Cloud Platform (GCP)
The Team
This team helps clients modernize data environments and build scalable platforms for analytics, reporting, and decision-making. Professionals work across strategy, architecture, implementation, and deployment to improve how organizations manage and use data. Collaboration with business and technology stakeholders is common to deliver cloud-enabled, enterprise-scale solutions.
Location
Stamford, CT (onsite)
Compensation
USD 134,500 - 265,100 per yearly
Information for Applicants with a Need for Accommodation
Similar Jobs
