Senior Machine Learning Engineer, Personalization, Magenta
Job Description
Join Spotify's Magenta Personalization team in New York to shape production-grade ML systems powering conversational and agentic AI experiences, along with scalable, high-quality user-facing recommendations. This hybrid role offers the chance to influence how millions of users interact with intelligent features, backed by a comprehensive benefits package and a collaborative, learning-focused culture. Salary range: USD 184,050 - 262,928 per year.
Responsibilities
- Design and ship production-grade machine learning systems powering conversational and agentic AI experiences
- Build systems that interpret user intent, manage context across multi-turn interactions, and handle ambiguity reliably at scale
- Develop and evolve agentic workflows including memory, context management, and multi-step tool orchestration
- Create evaluation frameworks, including LLM-as-judge pipelines, to measure quality and guide iteration
- Partner closely with product, engineering, and design to deliver seamless, user-facing experiences
- Balance experimentation with production rigor, ensuring performance, latency, and reliability at Spotify scale
- Continuously improve agent behavior through tight feedback loops between evaluation and real-world usage
Requirements
- 5+ years of experience building and shipping machine learning systems in production environments
- Experience with large language models and real-world applications beyond experimentation; shipped and maintained large-scale systems with LLMs
- Deep understanding of challenges in conversational or agentic systems, such as context handling and multi-step reasoning
- Ability to evaluate ML systems rigorously and experience designing metrics or evaluation pipelines
- Comfort debugging complex interactions between models, tools, and system constraints like latency
- Commitment to building reliable, scalable systems that deliver high-quality user experiences
- Enjoy working cross-functional and contributing to a collaborative, inclusive team environment
Technologies
- Large language models (LLMs)
Benefits
- health insurance
- six month paid parental leave
- 401(k) retirement plan
- monthly meal allowance
- 23 paid days off
- 13 paid flexible holidays
- paid sick leave
- Extensive learning opportunities, through our dedicated team, GreenHouse
- Flexible share incentives letting you choose how you share in our success
- Global parental leave, six months off - for all new parents
- All The Feels, our employee assistance program and self-care hub
- Flexible public holidays, swap days off according to your values and beliefs
Where you’ll be
This role is based in New York. We offer you the flexibility to work where you work best. There will be some in person meetings, but still allows for flexibility to work from home.