Machine Learning Engineer

As a Machine Learning Engineer at NVIDIA in Santa Clara, CA, you will help build and improve GeForce G-Assist, an on-device AI assistant that uses small language models, retrieval, and hybrid cloud capabilities. The work includes production evaluation, multimodal support, local inference optimization, and integration of retrieval-augmented and agentic AI workflows.

Responsibilities

• Evaluate and improve Small Language Models powering GeForce G-Assist, focusing on accuracy, robustness, and conversational reliability.
• Identify and mitigate conversation and context contamination, including state drift, prompt leakage, and retrieval cross-talk.
• Collaborate across SLM and VLM architectures to support both text and multimodal interactions.
• Contribute to hybrid designs that combine local SLMs with cloud-based models.
• Optimize local inference using llama.cpp, including quantization, memory usage, and performance tuning.
• Read, write, and optimize C/C++ code in performance-critical components.
• Design and integrate retrieval-augmented generation (RAG) systems that ground responses in system and user context.
• Support agentic AI workflows that enable planning, tool use, and multi-step execution.

Requirements

• 5+ years of validated experience in system software or a related field, plus an M.S. or higher degree in Computer Science, Data Science, Engineering, or a related field, or equivalent experience.
• Strong ability to read and write C/C++ code in systems-level or performance-sensitive environments, and proficiency in Python.
• Hands-on experience with llama.cpp or similar local inference frameworks.
• Hands-on experience evaluating Small Language Models, including task-based and conversational testing, with understanding of conversation dynamics, long-context behavior, and contamination risks.
• Knowledge of SLM and VLM architectures and trade-offs, experience with retrieval technologies and language-model integration, and familiarity with agentic AI patterns such as tool use and planning.

Technologies

• C/C++, Python, llama.cpp
• Small Language Models (SLMs), VLM architectures
• Retrieval-augmented generation (RAG)
• Agentic AI workflows

Ways to Stand Out

• Experience contributing to language or multimodal models that support user-facing products, features, or workflows.
• A history of collaborating with product, platform, or systems teams to balance model capability, performance, and user experience.
• Demonstrated ability to translate user needs or feedback into measurable improvements in model behavior or system reliability.

Compensation and Additional Information

The base salary will be determined based on your location, experience, and pay for employees in similar positions. The base salary range is USD 152,000 - 241,500 for Level 3 and USD 184,000 - 287,500 for Level 4. You will also be eligible for equity and benefits.

• Location: Santa Clara, CA (onsite)
• Salary: USD 152,000 - 287,500 per yearly
• Applications accepted at least until: October 20, 2026
• Posting type: Existing vacancy
• NVIDIA uses AI tools in its recruiting processes