DataJobs.io
← Back to all jobs

Job Description

Deloitte’s AI & Engineering team is seeking a Databricks Engineer to build reliable, high-performing data capabilities on the Databricks Lakehouse platform. This onsite role in Washington, DC focuses on developing and optimizing data pipelines, strengthening governance, and improving performance with Databricks and SQL-related engineering practices.

Compensation: USD 107,700 - 179,500 per year. Minimum experience: 2+ years. Education: Bachelor’s degree.

What you’ll do

  • Develop and optimize data pipelines using Python, PySpark, and SQL on the Databricks Lakehouse platform
  • Use Medallion architecture patterns to organize, transform, and manage data across data layers
  • Conduct performance tuning for Databricks workloads and SQL queries
  • Configure row-level and column-level security and manage data lineage and data sharing in Unity Catalog
  • Implement CI/CD and testing processes for Databricks workflows

What you bring

  • Bachelor’s degree
  • Ability to obtain and maintain the required clearance for this role
  • 2+ years of Databricks engineering experience
  • 4+ years of experience with Python, PySpark, and SQL
  • Ability to travel 10-15%, on average, based on the work you do and the clients and industries/sectors served
  • Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future

Additional skills that support success

  • Work independently and collaborate effectively as part of a team
  • Strong written and verbal communication skills
  • Meticulous attention to detail and a focus on quality
  • Ability to build and sustain professional relationships
  • Capability to lead projects or workstreams
  • Strong ability to manage and prioritize multiple tasks in a fast-paced environment
  • Interpersonal skills and professional demeanor
  • Ability to meet deadlines
  • Provide clear guidance to others

Preferred experience

  • Experience using Medallion architecture in the Databricks Lakehouse platform
  • Experience configuring row-level and column-level security, data lineage, and data sharing in Unity Catalog
  • Experience implementing CI/CD and testing processes for Databricks
  • Experience with performance tuning in Databricks

Technologies: Python, PySpark, SQL, Databricks Lakehouse, Medallion architecture, Unity Catalog, CI/CD

Similar Jobs