DataJobs.io
← Back to all jobs

Job Description

Freshfields is seeking a hands-on Data Engineer (3 to 5 years’ experience) to help build and run a modern, cloud-based data platform. Working within the Global Data Office in a fast-paced environment, you’ll design scalable data pipelines and data products on Microsoft Azure using Databricks and Delta Lake, while supporting data governance and data quality initiatives. The outcome: trusted data that underpins reporting, analytics, AI, and machine learning across the firm.

What you’ll do

  • Design, develop, and maintain batch and near real-time ETL/ELT pipelines with Azure Data Factory, Databricks, PySpark, and SQL.
  • Ingest, transform, and deliver data from multiple enterprise source systems.
  • Create reusable, scalable data processing components aligned with engineering standards.
  • Build and maintain data lake and lakehouse solutions using Azure Data Lake, Databricks, and Delta Lake.
  • Support data models that enable analytics, reporting, and self-service data consumption.
  • Develop reusable data products and datasets to improve access and consistency.
  • Implement data quality controls, validation frameworks, and monitoring within pipelines.
  • Support metadata management, data cataloguing, and lineage using tools such as Collibra and Purview.
  • Monitor pipeline reliability and processing workloads, investigate issues, and resolve data or platform problems in a timely manner.
  • Identify opportunities to improve performance, scalability, and cloud cost efficiency.
  • Collaborate with Data Architects, Lead Data Engineers, Data Analysts, and business stakeholders to deliver solutions aligned to business requirements.
  • Participate in agile ceremonies (sprint planning, stand-ups, retrospectives) and support testing, deployment, and release activities for data products and platforms.
  • Follow established standards, coding practices, documentation requirements, and contribute to peer reviews and continuous improvement.
  • Maintain technical documentation, solution designs, and operational procedures, and support knowledge sharing across the Data Office.

What you bring

  • 3 to 5 years of experience in data engineering or a related technical discipline.
  • Hands-on experience building ETL/ELT pipelines in the cloud, preferably on Microsoft Azure.
  • Strong working knowledge of Databricks, SQL, and Python/PySpark.
  • Experience with enterprise data platforms and architectures including data warehouses, data lakes, or lakehouse.
  • Familiarity with data governance, metadata management, and data quality concepts.
  • Experience using Git and contributing to CI/CD processes.
  • Experience with Azure Data Lake Storage Gen2 and Azure Data Factory.
  • Experience with Azure Synapse Analytics.
  • Understanding of Delta Lake concepts and modern lakehouse architectures.
  • Familiarity with dbt (data build tool).
  • Exposure to CI/CD practices using Azure DevOps or GitHub, plus basic understanding of orchestration tools such as Apache Airflow.
  • Knowledge of data lineage, metadata management, and data governance principles.
  • Advantageous: experience with Collibra, Purview, and Azure Functions, and exposure to CI/CD using GitHub.
  • Strong analytical and problem-solving skills, effective verbal and written communication, and the ability to collaborate across technical and business teams.
  • Comfort in Agile environments, a curious mindset, and strong attention to detail.
  • Bachelor’s degree in computer science, engineering, information systems or a related field (or equivalent practical experience).

Location: Raleigh, NC (onsite)

Similar Jobs