ServiceNow seeks a Senior Machine Learning Engineer to design and scale the ML infrastructure that trains and serves large language models, with work linked to Moveworks, now part of ServiceNow. The role emphasizes distributed training and inference, evaluation and monitoring, and latency optimization, and is based onsite in Mountain View, California.
Responsibilities
- Design, implement, and optimize scalable ML infrastructure to enable training, evaluation, and deployment of large language models.
- Create abstractions to automate steps across diverse ML workflows.
- Partner with engineers, data analytics, ML experts, and product teams to deliver new features.
- Leverage experience to advance best practices in ML and data engineering.
Requirements
- 5+ years of professional experience in machine learning, infrastructure, or related fields.
- Experience with deep learning frameworks such as Pytorch or Huggingface, or LLM serving frameworks such as vLLM or TensorRT-LLM.
- Experience building and scaling end-to-end machine learning systems.
- Experience building scalable microservices and ETL pipelines.
- Expertise in Python with familiarity in performant languages such as C++ or GoLang.
- Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
- An interest in research publications within the machine learning and software engineering communities.
- Effective communicator with experience collaborating cross-functionally with other teams.
Technologies
- Pytorch
- Huggingface
- vLLM
- TensorRT-LLM
- Python
- C++
- GoLang
Base Salary Range
$161,300 - $274,200 per year
Work Personas
ServiceNow classifies work arrangements by personas based on the nature of the work and location. Eligibility for a work persona may be determined by the distance between your primary residence and the nearest ServiceNow office, as verified by a third-party service.
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will be considered for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. Applicants with arrest or conviction records will be considered in accordance with legal requirements.
Accommodations
We strive to create an accessible and inclusive candidate experience. If you require a reasonable accommodation to complete any part of the application process, or need an alternative method to apply, please contact globaltalentss@servicenow.com for assistance.
Export Control Regulations
Positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), may require export control approvals from government authorities. All employment is contingent upon ServiceNow obtaining any export licenses or approvals as required by applicable authorities.
