DataJobs.io
← Back to all jobs

Job Description

Capgemini is hiring a Senior Data Engineer to design, build, and optimize scalable data solutions on the Databricks Lakehouse Platform in Atlanta, GA.

Responsibilities

  • Define and deploy an end-to-end data architecture that includes Databricks medallion architecture
  • Lead large teams of engineers and developers to deploy Databricks solutions
  • Manage senior client stakeholders effectively

Requirements

  • 6+ years of experience in Data Engineering
  • At least 4 years designing and delivering data engineering solutions with Databricks
  • Expert hands-on development with PySpark/Python
  • Expert hands-on SQL development skills
  • Hands-on cloud platform experience in two of: Azure, AWS, Google Cloud
  • Prior expertise deploying Delta Lake solutions into production
  • Experience extracting value from large and complex data sets from various sources and databases
  • Solid grasp of database engineering and design principles
  • CI/CD familiarity desired
  • Experience working with orchestration tools such as Airflow
  • Strong knowledge of Unity Catalog
  • Experience with ETL tools such as Infomatica, Talend, Matillion desired
  • Delta Sharing and Marketplace expertise
  • Experience working with Databricks Apps
  • Working knowledge of Databricks Genie, AI/BI, and Databricks Data Visualization capabilities
  • Conceptual, Logical, and Physical Data Modeling experience preferred

Technologies

  • Databricks Lakehouse Platform
  • Apache Spark, PySpark, Python
  • Delta Lake
  • Azure, AWS, GCP
  • SQL
  • Unity Catalog
  • Airflow
  • Infomatica, Talend, Matillion
  • Delta Sharing, Databricks Marketplace
  • Databricks Apps
  • Databricks Genie, AI/BI
  • Databricks Data Visualization
  • CI/CD

Benefits

  • Paid time off based on employee grade (A-F), per policy: Vacation: 12-25 days depending on grade
  • Company paid holidays
  • Personal days
  • Sick leave
  • Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
  • Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
  • Life and disability insurance
  • Employee assistance programs
  • Other benefits as provided by local policy and eligibility

Location: Atlanta, GA (onsite)

Salary: USD 89,400 - 166,398 per yearly

Minimum Experience: 6 years

Similar Jobs