DataJobs.io
← Back to all jobs

Job Description

National Grid is seeking a Senior Data Engineer to help build and evolve a forecasting platform that supports reliable, end-to-end data pipelines. In this hybrid role, you will bring together large datasets from multiple sources while strengthening data quality, governance, and modern data engineering practices across the organisation.

Role focus

  • Build and maintain scalable data pipelines that are robust, well-tested, and designed to meet growing business needs.
  • Design and evolve data integrations and APIs to handle increasing data volumes and complexity.
  • Develop scalable data solutions aligned with architectural roadmaps and standards across integration, storage, reporting, and analytics.
  • Collaborate with analytics and business teams to improve data models, increase data accessibility, and enable better decision-making.

What you’ll do

  • Champion data quality and governance, ensuring data is secure, consistent, reliable, and accessible.
  • Enhance data integration and quality frameworks with strong unit, integration, and functional testing.
  • Build and automate distributed data solutions that collect and process streaming events from multiple sources.
  • Investigate and resolve complex data issues using data analysis to identify root causes and implement effective solutions.
  • Guide and mentor junior engineers by sharing best practices in coding, engineering standards, and optimisation.

Required experience and skills

  • 5 years (or around 5 years) of relevant experience in data engineering, analytics, or business intelligence.
  • Strong programming skills, including Python, with hands-on experience in PySpark and SQL.
  • Experience with Databricks and building scalable data solutions.
  • Experience designing and developing integrations across multiple systems and APIs.
  • Hands-on experience with Azure data technologies, including Azure Data Lake, Azure Data Factory, Azure DevOps, and Azure Functions.
  • Strong SQL expertise, including working with and optimising queries across large, complex datasets.
  • Experience with data warehousing and developing ETL and/or ELT pipelines.
  • Understanding of Agile software development and modern engineering practices.
  • Excellent problem-solving and troubleshooting skills with a structured, process-driven approach.
  • Strong documentation skills and a focus on maintainable, well-engineered solutions.
  • A degree or equivalent experience in a technical discipline, ideally Computer Science, Mathematics, Statistics, or another related field.

Technologies

Python, PySpark, SQL, Databricks, Azure Data Lake, Azure Data Factory, Azure DevOps, Azure Functions, ETL, ELT

Hybrid locations and salary

  • Hicksville, NY (hybrid)
  • Salary: USD 129,000 - 180,000 per year
  • Location-specific range: Waltham $129k–$170k; Brooklyn/Hicksville $137k–$180k

Team and job purpose

  • Team: Information Technology and Digital
  • City coverage includes Hicksville, Waltham, and Brooklyn (IT and Digital)

As part of a collaborative, cross-functional development team, you’ll design and build scalable, end-to-end pipelines that support forecasting, analytics, and reporting. You’ll use Agile ways of working and engineering principles to ensure data is reliable, accessible, and ready to power insights. The role also includes opportunities to modernise the data engineering architecture, tools, and ways of working to improve scalability, performance, and delivery speed.

Nice to have

  • Experience designing data schemas and working with SQL and NoSQL databases.
  • Knowledge of Kafka, Flink, Fivetran, or Matillion.
  • Exposure to Data Science and Machine Learning.
  • Background in software engineering.
  • Experience working with Snowflake.

Additional notices

  • No visa sponsorship is provided for this position now or in the future. Candidates must be able to work without current or future visa sponsorship.
  • National Grid uses an AI or statistically based assessment to evaluate qualifications and characteristics.
  • The role includes a career path with advancement opportunities within and across bands as you grow technical skills.
  • National Grid is committed to equal employment opportunities and does not discriminate based on protected class under applicable laws.

Similar Jobs