Data Engineer
Azure
Azure Data Factory
Azure Data Lake
Azure Functions
Azure Synapse Analytics
Data Architecture
Data Engineer
Data Engineering
Data Factory
Data Factory Azure
Data Integration
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Databricks
ETL
Microsoft Azure
Pyspark
Spark
SQL
Job Description
Freshfields is seeking a hands-on Data Engineer (3 to 5 years’ experience) to help build and run a modern, cloud-based data platform. Working within the Global Data Office in a fast-paced environment, you’ll design scalable data pipelines and data products on Microsoft Azure using Databricks and Delta Lake, while supporting data governance and data quality initiatives. The outcome: trusted data that underpins reporting, analytics, AI, and machine learning across the firm.
What you’ll do
- Design, develop, and maintain batch and near real-time ETL/ELT pipelines with Azure Data Factory, Databricks, PySpark, and SQL.
- Ingest, transform, and deliver data from multiple enterprise source systems.
- Create reusable, scalable data processing components aligned with engineering standards.
- Build and maintain data lake and lakehouse solutions using Azure Data Lake, Databricks, and Delta Lake.
- Support data models that enable analytics, reporting, and self-service data consumption.
- Develop reusable data products and datasets to improve access and consistency.
- Implement data quality controls, validation frameworks, and monitoring within pipelines.
- Support metadata management, data cataloguing, and lineage using tools such as Collibra and Purview.
- Monitor pipeline reliability and processing workloads, investigate issues, and resolve data or platform problems in a timely manner.
- Identify opportunities to improve performance, scalability, and cloud cost efficiency.
- Collaborate with Data Architects, Lead Data Engineers, Data Analysts, and business stakeholders to deliver solutions aligned to business requirements.
- Participate in agile ceremonies (sprint planning, stand-ups, retrospectives) and support testing, deployment, and release activities for data products and platforms.
- Follow established standards, coding practices, documentation requirements, and contribute to peer reviews and continuous improvement.
- Maintain technical documentation, solution designs, and operational procedures, and support knowledge sharing across the Data Office.
What you bring
- 3 to 5 years of experience in data engineering or a related technical discipline.
- Hands-on experience building ETL/ELT pipelines in the cloud, preferably on Microsoft Azure.
- Strong working knowledge of Databricks, SQL, and Python/PySpark.
- Experience with enterprise data platforms and architectures including data warehouses, data lakes, or lakehouse.
- Familiarity with data governance, metadata management, and data quality concepts.
- Experience using Git and contributing to CI/CD processes.
- Experience with Azure Data Lake Storage Gen2 and Azure Data Factory.
- Experience with Azure Synapse Analytics.
- Understanding of Delta Lake concepts and modern lakehouse architectures.
- Familiarity with dbt (data build tool).
- Exposure to CI/CD practices using Azure DevOps or GitHub, plus basic understanding of orchestration tools such as Apache Airflow.
- Knowledge of data lineage, metadata management, and data governance principles.
- Advantageous: experience with Collibra, Purview, and Azure Functions, and exposure to CI/CD using GitHub.
- Strong analytical and problem-solving skills, effective verbal and written communication, and the ability to collaborate across technical and business teams.
- Comfort in Agile environments, a curious mindset, and strong attention to detail.
- Bachelor’s degree in computer science, engineering, information systems or a related field (or equivalent practical experience).
Location: Raleigh, NC (onsite)