← All roles

Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA· Architect
Apply on company site
Santa Clara, CA, Hybrid (US (Remote))$184k - $356.5kFull-timePosted 2mo ago

About the role

Product Architect responsible for designing and overseeing the development of cutting-edge AI infrastructure solutions, focusing on datacenter-scale Kubernetes-based environments, performance, scalability, and integration across networking, compute, and storage.

Responsibilities

  • Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
  • Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
  • Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance
  • Iterate and refine designs based on feedback, testing results, and evolving requirements
  • Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems
  • Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision
  • Provide comprehensive documentation for product designs, including technical specifications and user guides
  • Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

Qualifications

  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
  • Bachelor’s degree in computer science or related field (or equivalent experience)
  • Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage
  • Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
  • Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation
  • Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
  • A passion for staying updated with the latest technological advancements in AI and related fields

Skills

Required:Datacenter-scale HPC/AI infrastructure architectureProduct architecture & designDevOps tooling (Python, Ansible)Container runtimes & KubernetesAI workloads & agentic/RAG workflows

Benefits

  • Equity
  • benefits (as per company page)
Last updated Aug 21, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA