Senior Machine Learning Engineer, Agentic Systems

At ServiceNow's Moveworks division, the Agentic Systems group seeks a Senior Machine Learning Engineer to help scale the infrastructure that powers large language models. This role centers on building robust training and inference pipelines, implementing evaluation and monitoring practices, optimizing latency, and working closely with cross-functional teams to deliver impactful ML features in a production environment.

Responsibilities

• collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
• leverage your experience to drive best practices in ML and data engineering

Requirements

• 5+ years of industry experience in Machine Learning, Infrastructure or related fields
• Experience with deep learning frameworks such as PyTorch or HuggingFace or LLM serving frameworks such as vLLM or TensorRT-LLM
• Experience with building and scaling end-to-end machine learning systems
• Experience building scalable micro services and ETL pipelines
• Expertise in Python and experience with performant languages such as C++ or Go
• Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field
• A love of research publications in the machine learning and software engineering communities
• Effective communicator with experience collaborating cross-functionally with other teams

Technologies

• PyTorch
• HuggingFace
• vLLM
• TensorRT-LLM
• Python
• C++
• Go

Location

Mountain View, CA (onsite)

Base Salary Range

USD 161,300 - 274,200 per year

Work Persona

ServiceNow assigns work personas based on the nature of the work and location to reflect flexibility, trust, and the distribution of the workforce.