← All roles

Senior Product Manager, Switchyard

NVIDIA· Product Management
Apply on company site
Hybrid (Santa Clara, CA)$168k - $327.8kFull-timePosted 2w ago

About the role

Senior Product Manager to lead Switchyard, NVIDIA’s adaptive inference runtime for systems of models, responsible for product strategy, developer experience, integrations, GTM, and cross-team coordination to optimize task-level quality, cost, latency, and policy compliance.

Responsibilities

  • Drive Switchyard’s product strategy and roadmap. Set priorities, quality bars, and clear product outcomes together with Engineering.
  • Work directly with agent harness builders, inference gateways, model serving systems, and other partners to ensure successful integrations and translate market feedback into product capabilities.
  • Define the developer experience and product interfaces for adaptive inference.
  • Partner with Research to translate advances in cost and quality prediction, constrained optimization, and budget allocation into usable products and features.
  • Partner with Engineering to improve reliability, usability, documentation, SDK coverage, and the customization path for production deployments.
  • Build the adoption motion with Product Marketing, Solution Architects, and GTM teams. Identify qualified workloads, guide partner pilots, and build repeatable deployment playbooks.
  • Establish messaging and narrative for model routing and adaptive inference, coordinating with Product Marketing.
  • Define and inspect the evidence for success. Own the outcomes.
  • Coordinate across adjacent teams to build compelling joint product outcomes.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or related field, or equivalent experience.
  • 8+ years of product management or closely related experience building technical products for developers, infrastructure teams, or AI practitioners.
  • A record of scaling developer or infrastructure products through a partnership motion and integrations, not only through a single first-party application.
  • Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs. Able to reason about quality/cost/latency tradeoffs.
  • Ability to engage mature customers and partners independently, uncover production constraints, and guide GTM teams through complex technical adoption.
  • Positive relationships with Engineering and Research teams. Able to ask sharp questions, convert uncertainty into decisions, and support teams without prescribing implementation.
  • Evidence-driven product approach grounded in benchmarks, evals, and explicit success criteria.
  • Excellent written and verbal communication, good judgment, and the ability to align senior technical and business leaders across boundaries.
  • Enough technical depth to inspect APIs, traces, and benchmark results and earn the trust of senior researchers and engineers.

Skills

Required:Product managementDeveloper relationsLLM inference

Benefits

  • Equity
  • Benefits (see NVIDIA benefits)
Last updated Oct 9, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm

More open roles at NVIDIA