← All roles

Senior Product Manager - AI Platform Inference

NVIDIA· Product Management
Apply on company site
Santa Clara, CA$168k - $327.8kfull-timePosted 2mo ago

About the role

Senior Product Manager responsible for building tools, SDKs, and libraries to enable developers' inference deployments on NVIDIA GPUs, with focus on strategy, roadmaps, and go-to-market planning for AI Platform Inference.

Responsibilities

  • Create products to help developers build better Inference deployments
  • Develop product strategy, roadmaps, and go-to-market plans
  • Collaborate with internal and external developers to build product-based roadmaps for model optimization software
  • Work with leadership to align with and drive company strategy

Qualifications

  • Experience with Inference deployment and optimization software (ex. vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO, etc.)
  • Demonstrable knowledge of GenAI or machine learning concepts, particularly around performance optimization, and software development and delivery
  • BS or MS degree in Computer Science, Computer Engineering, or similar experience (or equivalent experience)
  • 6+ years of technical product management, or similar, experience at a technology company
  • Strong communication and interpersonal skills

Skills

Required:Inference deployment and optimizationGenAI / machine learning conceptsCommunication

Benefits

  • equity
  • benefits (see company benefits link)
Last updated Aug 7, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA