Data Engineer-Data Platform & Analytics

Responsibilities

• Lead the design, development, and operation of scalable ETL and ELT pipelines to enable enterprise and commercial data delivery within Moody's Databricks environment.
• Create and manage scalable pipelines to ingest, transform, and publish data across multiple domains.
• Build and optimize data transformations and validations using Python, PySpark, Scala, and SQL.
• Develop configuration-driven and metadata-driven pipeline frameworks to onboard and govern datasets efficiently.
• Ensure data products are well structured, high-performing, and ready for downstream consumption.
• Collaborate with stakeholders to define data contracts, schemas, SLAs, and quality standards.
• Apply best practices for data reliability, observability, and cost optimization of pipelines.
• Contribute to CI/CD efforts, including automated testing, deployment, and promotion processes.
• Support data governance initiatives, including data quality, lineage, and access controls.

Requirements

• Minimum of five years of data engineering experience building and operating production-grade pipelines.
• Strong programming skills in Python, PySpark, Scala, and SQL.
• Experience designing or working with configuration- or metadata-driven data pipelines.
• Hands-on experience with a Databricks-based data platform.
• Solid understanding of data modeling, schema evolution, and large-scale dataset management.
• Experience deploying and operating data solutions in AWS and Azure cloud environments.
• Working knowledge of CI/CD concepts and integrating data pipelines into automated workflows.
• Demonstrated proficiency with AI tools to streamline workflows, with awareness of responsible and ethical AI use.

Technologies

• Python
• PySpark
• Scala
• SQL
• Databricks
• AWS
• Azure

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• Parental leave
• Paid time off
• 401(k) plan with employer and employee contributions
• Life insurance
• Disability insurance
• Accident insurance
• Discounted Employee Stock Purchase Plan
• Tuition reimbursement

About the Team

• The team operates within the Enterprise Data Platform CORE, supporting a mission-critical portion of Moody's data estate.
• It is a modern, innovation-driven data engineering group that powers Moody’s large financial and corporate databases, enabling data-driven insights and contributing to Moody’s leadership in an increasingly AI-enabled landscape.