Senior Machine Learning Engineer

Senior Machine Learning Engineer at ServiceNow (Moveworks) focused on building and scaling ML infrastructure for training and serving large language models, with emphasis on distributed training, inference pipelines, evaluation, latency optimization, and productionizing infrastructure.

Responsibilities

• Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
• Create abstractions to automate steps across diverse ML workflows.
• Collaborate with cross functional teams of engineers, data analytics professionals, machine learning experts, and product stakeholders to deliver new features.
• Apply experience to drive ML and data engineering best practices across projects.

Requirements

• 5+ years of industry experience in machine learning, infrastructure, or related fields.
• Hands-on experience with deep learning frameworks such as Pytorch or Huggingface, or LLM serving frameworks like vLLM or TensorRT-LLM.
• Experience building and scaling end-to-end machine learning systems.
• Experience building scalable micro services and ETL pipelines.
• Expertise in Python and experience with performant languages such as C++ or GoLang.
• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
• Interest in research publications within the machine learning and software engineering communities.
• Effective communicator with experience collaborating cross-functionally with other teams.

Technologies

• Pytorch
• Huggingface
• vLLM
• TensorRT-LLM
• Python
• C++
• GoLang

Additional Information

• Work Personas: ServiceNow supports flexible work arrangements with categories based on work nature and location. Eligibility is determined by proximity to the nearest ServiceNow office, assessed via a third-party service.
• Equal Opportunity Employer: ServiceNow provides equal employment opportunities irrespective of race, color, creed, religion, sex, sexual orientation, national origin, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other protected status. Applicants with arrest or conviction records will be considered in accordance with applicable law.
• Accommodations: For reasonable accommodations or alternative application methods, contact [email protected].
• Export Control Regulations: Some roles may require export control approvals; employment is contingent upon obtaining any necessary licenses or approvals from government authorities.