← All roles

Senior System Architect, Enterprise Reference Architectures

NVIDIA· Product Management
Apply on company site
Santa Clara, CA, Austin, TX, Westford, MA, Boulder, CO$208k - $327.8kPosted 5mo ago

About the role

Senior System Architect to define, design, and validate enterprise AI factory reference architectures, translating customer requirements into architecture patterns, validation plans, and field-ready technical guidance across NVIDIA accelerated computing, networking, storage, and AI software.

Responsibilities

  • Define and drive full-stack enterprise AI factory baseline architectures across compute, networking, storage, virtualization, orchestration, security, observability, and NVIDIA AI software to deliver on-prem cloud native-platform and cluster reference builds.
  • Architect reference builds for end-to-end software systems and platforms based on scalable, portable, and resilient builds; evaluate different platforms, capture differences in implementations, and research platform behavior under varying workloads.
  • Collaborate with Product Management, Product Architects, Engineering, Solution Architecture, Program Management, and field teams to develop product direction, architecture requirements, roadmap inputs, and execution plans.
  • Develop and validate scalable cluster designs for enterprise AI/ML systems, including on-prem and hybrid-cloud deployments for training, fine-tuning, inference, agentic AI, physical AI, and HPC workloads.
  • Evaluate tradeoffs across performance, scalability, resiliency, manageability, security, power, cooling, cost, TCO, and operational complexity.
  • Understand design patterns, business logic, component-based architecture, and evolutionary architecture.
  • Build and detail comprehensive API strategies, middleware integrations, and orchestration workflows for seamless communication across distributed enterprise software.
  • Integrate with non-cloud technologies and third-party vendor products/services.

Qualifications

  • Bachelor's degree or equivalent experience.
  • 12+ years of software or infrastructure architecture experience.
  • 3+ years of experience with micro-services architectures.
  • Experience with system architecture, performance, and networking for distributed solutions.
  • Proven experience designing, building, or maintaining complex AI, HPC, or cloud-native infrastructure from rack-scale systems to full data center deployments.
  • Proven expertise in crafting and deploying complete software platforms spanning edge, on-premises, and cloud environments.
  • Strong understanding of GPU-accelerated systems, high-density servers, PCIe, NVLink, CPU/GPU platform design, rack integration, power, cooling, mechanical constraints, and data center deployment realities.
  • Deep networking knowledge across Ethernet, InfiniBand, RDMA, RoCE, routing, switching, congestion control, network segmentation, and high-performance cluster fabrics.
  • Deep proficiency in modern integration patterns, event-driven architectures (e.g., Kafka, RabbitMQ), and container orchestration (e.g., Kubernetes, Docker).
  • Strong grasp of cloud-native systems with emphasis on high availability, scalability, and security in compute environments.

Skills

Required:Enterprise system architecture

Benefits

  • equity
  • benefits (as per company listing)
Last updated Jul 3, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA