← All roles

Principal Software Engineer - Rack Scale Systems Infrastructure

NVIDIA· Engineer, Sys SW
Apply on company site
Hybrid (Remote / Local)$272k - $431.3kFull-timePosted 5mo ago

About the role

Principal Rack Scale Systems Infrastructure Engineer responsible for defining and building software systems that manage rack-scale infrastructure, bridging hardware and software, and coordinating across firmware, OS lifecycle, networking fabrics, and orchestration in collaboration with hyperscalers, CSPs, and enterprise customers.

Responsibilities

  • Define the complete software architecture for rack-scale infrastructure products and services, covering control plane services, infrastructure management, firmware, operating systems, kernel drivers, networking fabrics, accelerator software, and user-mode manageability software.
  • Use Kubernetes and cloud-native primitives as an infrastructure fabric when appropriate, including controllers, operators, reconciliation loops, and open source components; build open source infrastructure software for internal deployments and CSP environments.
  • Bridge hardware and software teams across firmware, BMC, BIOS, boot flows, OS images, drivers, networking, NVLink domains, InfiniBand, GPUs, DPUs, CPUs, and system management interfaces; translate roadmaps into software requirements and execution plans.
  • Partner with hyperscalers, CSPs, enterprise customers, internal component leads, vendors, and partners to align infrastructure capabilities with deployment needs; establish reliability, security, validation, and left-shift strategies.
  • Mentor senior engineers and technical leads to raise the engineering bar for large-scale networked systems and rack-scale control plane development.
  • Make high-quality technical decisions in ambiguous environments balancing customer needs, schedule, hardware realities, software maintainability, open source adoption, and long-term evolution.

Qualifications

  • BS or MS in Computer Engineering, Computer Science, Electrical Engineering, or related field, or equivalent experience.
  • 15+ years in systems architecture, system software, distributed systems, infrastructure control planes, or infrastructure engineering.
  • Solid architectural knowledge of coordination frameworks, state machines, declarative APIs, reconciliation loops, lifecycle orchestration, failure handling, upgrade/rollback workflows, and distributed systems tradeoffs.
  • Proficiency in Go, C++, or Rust; production-quality infrastructure software; Rust experience highly valued.
  • Experience with Kubernetes or similar orchestration systems; Linux-based infrastructure software, OS rollout and image management, kernel/driver interactions, firmware lifecycle, and hardware bring-up workflows.
  • Strong understanding of data center networking technologies (Ethernet, InfiniBand, RDMA) and accelerator-based systems (GPUs, DPUs, FPGAs, custom silicon).
  • Expertise in in-band and out-of-band management architectures (BMCs, Redfish, IPMI); ability to work with security experts on secure boot, attestation, access control, update safety, serviceability.
  • Experience crafting software for open source release (API stability, documentation, community usability).
  • Experience using AI-assisted development tools responsibly for coding, testing, debugging, build iteration, and documentation.
  • Established skills in specifying requirements, guiding architecture, and managing delivery across engineering teams; strong written and verbal communication.

Skills

Required:GoC++RustKubernetesBMC/Redfish/IPMINetworking (Ethernet/InfiniBand/RDMA)
Nice to have:Linux kernel/driver interactionsOpen source software

Benefits

  • equity
  • benefits
Last updated Oct 23, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA