← All roles

Principal Software Engineer - Compute Infrastructure

NVIDIA· Engineer, SW
Apply on company site
Hybrid (Santa Clara, CA), Hybrid (Remote US)$248k - $391kFull-timePosted 1mo ago

About the role

Lead the architectural vision and operationalization of NVIDIA's global compute and AI inference infrastructure, spanning on-prem and cloud, with emphasis on Kubernetes-based virtualization, large-scale automation, and platform adoption across autonomous engineering teams.

Responsibilities

  • Define Platform Architecture: Architect and transform the global enterprise compute platform—running thousands of nodes and tens of thousands of VMs and containers via OpenShift and KubeVirt—by defining service tiers, SLAs, and automated cluster lifecycles.
  • Operationalize Frontier AI Infrastructure: Build the operational foundation for internal AI inference platform scaling to frontier-class models, including automated remediation pipelines, hardware watchdogs, and telemetry for pre-release, rack-scale GPU systems (Blackwell and upcoming architectures).
  • Drive Strategic Capacity & Scale: Collect and review system data for capacity planning under extreme hardware supply constraints; develop proactive strategies such as public cloud bursting, hardware dogfooding, and evaluating alternative compute architectures (e.g., ARM).
  • Build the "Paved Road": Collaborate with autonomous NVIDIA engineering teams to drive cultural adoption of standard platforms; design self-service architectures, APIs, and Terraform/OpenTofu providers that teams want to use.
  • Lead Complex Migrations: Evaluate existing application architectures and drive migrations of massive legacy workloads—including large-scale, long-running VDI environments—into modern Kubernetes orchestration.

Qualifications

  • Bachelor’s degree in Engineering, Computer Science, Mathematics, or related field, or equivalent experience.
  • 15+ years of proven experience in compute platform engineering, site reliability, or systems architecture with automation at massive scale.
  • Deep expertise in Kubernetes architecture and designing/deploying virtualization architectures, specifically operating VMs inside Kubernetes (KubeVirt, OpenShift).
  • In-depth knowledge of hardware technologies (GPUs, high-speed backplane networking) with a track record of mitigating hardware-level failures, silent data corruption, and anomalies in large-scale environments.
  • Experience running large global environments spanning bare metal, virtualized infrastructure, and cloud with a unified GitOps posture (ArgoCD or similar).
  • Proficiency in Go and/or Python, alongside expert-level infrastructure-as-code development (Terraform, Config Management).
  • Strong leadership skills with the ability to influence technical direction across highly autonomous teams.

Skills

Required:KubernetesKubeVirt/OpenShift virtualizationGoPythonTerraform / IaCGitOps / ArgoCD or equivalentLeadershipCapacity planning

Benefits

  • equity
  • benefits (see company benefits page)
Last updated Sep 4, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA