Machine Learning Engineer, GeForce G-Assist
NVIDIA· Engineer, Sys SW
Santa Clara, CA$152k - $287.5kFull-timePosted 4d ago
About the role
On-device AI assistant initiative (GeForce G-Assist) combining Small Language Models, retrieval systems, and hybrid cloud capabilities to deliver context-aware assistance within the GeForce ecosystem. Focuses on production behavior of models, local inference optimization, and retrieval-augmented generation in a performance-sensitive environment.
Responsibilities
- Evaluate and improve Small Language Models used in GeForce G-Assist with emphasis on accuracy, robustness, and conversational reliability; identify and mitigate conversation and context contamination (state drift, prompt leakage, retrieval cross-talk).
- Work with SLM and VLM architectures to support text and multimodal interactions; collaborate on hybrid architectures combining local SLMs with cloud-based models.
- Optimize local inference using llama.cpp, including quantization, memory usage, and performance tuning; read, write, and optimize C/C++ code in performance-critical paths.
- Design and integrate retrieval-augmented generation (RAG) systems that ground responses in system and user context; support agentic AI workflows enabling planning, tool use, and multi-step execution.
Qualifications
- 5+ years of validated experience in system software or related field; MS or higher in Computer Science, Data Science, Engineering, or related field (or equivalent experience).
- Strong ability to read and write C/C++ code in systems-level or performance-sensitive environments; proficiency in Python.
- Hands-on experience with llama.cpp or similar local inference frameworks.
- Hands-on experience evaluating Small Language Models, including task-based and conversational testing; understanding of conversation dynamics, long-context behavior, and contamination challenges.
- Knowledge of SLM and VLM architectures and their trade-offs; experience with retrieval technologies and language-model integration; familiarity with agentic AI patterns (tool use and planning).
Skills
Required:C/C++Pythonllama.cpp or local inference frameworks
Benefits
- equity
- benefits (as per company listing)
Last updated Oct 23, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer4d agoEngineer, ASIC
- Senior System Software Engineer, Display Security4d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware4d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer4d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence4d agoHybrid (Remote / Local) · Architect