Senior Machine Learning Engineer, Agentic Systems

ServiceNow is seeking a Senior Machine Learning Engineer to join the Agentic Systems group in Mountain View, onsite, to design and scale the end-to-end ML infrastructure that trains, evaluates, and deploys large language models. This role partners with cross-functional teams to translate research into robust production capabilities that support enterprise AI initiatives.

Location

Mountain View, CA (onsite)

Responsibilities

• Design and optimize scalable ML infrastructure to support training, evaluation, and deployment of large language models.
• Create abstractions to automate multiple steps across diverse ML workflows.
• Collaborate with cross-functional teams of engineers, data analytics, ML experts, and product to deliver new features.
• Apply your experience to promote best practices in ML and data engineering.

Requirements

• 5+ years of industry experience in Machine Learning, Infrastructure, or related fields.
• Experience with deep learning frameworks such as PyTorch or Huggingface, or LLM serving frameworks like vLLM or TensorRT-LLM.
• Experience building and scaling end-to-end machine learning systems.
• Experience building scalable micro services and ETL pipelines.
• Proficiency in Python and experience with performant languages such as C++ or GoLang.
• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
• A love of research publications in the machine learning and software engineering communities.
• Effective communicator with experience collaborating cross-functionally with other teams.

Technologies

• PyTorch
• Huggingface
• vLLM
• TensorRT-LLM
• Python
• C++
• GoLang