Data Engineer II

The Supportability & Customer-Centric Engagement and Engineering Direct (SUCCEED) team at Microsoft is hiring a Data Engineer II in Redmond, WA (onsite). The role designs and operates scalable data pipelines and analytics assets to support engineering, supportability, escalation, and operational intelligence use cases.

Role Summary

You will design, build, and maintain data pipelines, telemetry datasets, measurement models, and dashboards that enable data-driven decisions. Work is centered on creating trustworthy data products, improving measurement quality, and supporting operational reporting needs for engineering and customer support stakeholders.

Key Responsibilities

• Build and maintain data pipelines, transformations, semantic models, and curated datasets across engineering and operational data sources.
• Collaborate with product management, engineering, support teams, and leadership to define metrics, key business measures, and data quality expectations.
• Develop telemetry validation and implement checks for data freshness, completeness, and reliability.
• Create and maintain dashboards, scorecards, and operational reporting using Microsoft reporting tools or equivalent reporting experiences.
• Integrate data from sources including Azure DevOps, telemetry platforms, support and escalation systems, release-readiness sources, and business reporting tools.
• Automate manual reporting and intake workflows when possible.
• Improve discoverability, governance, ownership, and documentation for critical datasets.
• Support release readiness, customer health, feature adoption, supportability, and escalation analytics.
• Investigate data issues and root-cause anomalies, then drive fixes with upstream and downstream partners.

Required Qualifications

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year experience in business analytics, data science, software development, data modeling, or data engineering.
• OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements for this role.
• Ability to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Technologies

• Python
• PySpark
• Kusto Query Language
• Azure Data Explorer
• Microsoft Fabric
• Azure Synapse Analytics
• Apache Spark

Preferred Qualifications

• Experience using Python and PySpark scripting for data transformation, automation, validation, or analytics workflows.
• Experience building ELT/ETL pipelines, scheduled data refreshes, production data workflows, or reporting data models.
• Experience with Kusto Query Language, Azure Data Explorer, Microsoft Fabric, Azure Synapse Analytics, Apache Spark, or similar big-data platforms.
• Experience with telemetry, observability, product usage, supportability, or reliability datasets.
• 4+ years of experience with large-scale data platforms, telemetry, business intelligence reporting, or operational analytics.
• Proven experience developing and deploying autonomous artificial intelligence agents or agentic automation systems that reason over data, operate reliably in production, and generate continuous automated insight.

Compensation

USD 102,100 - 219,200 per year.

Data Engineering IC3 typical base pay range across the U.S.: USD 102,100 - 202,200 per year. Different ranges may apply for specific work locations within the San Francisco Bay area and New York City metropolitan area, with a base pay range of USD 133,800 - 219,200 per year.