← All roles

Principal AI and ML Infra Software Engineer, GPU Clusters

NVIDIA· Engineer, Sys SW
Apply on company site
Santa Clara, CA, Redmond, WA$272k - $431.3kfull-timePosted 5mo ago

About the role

Principal AI and ML Infra Software Engineer focused on GPU clusters to enhance AI/ML research infrastructure, collaborating with researchers and cross-functional teams to build scalable, high-performance HPC infrastructure.

Responsibilities

  • Engage closely with AI/ML research teams to discern infrastructure requirements and barriers, converting insights into actionable improvements.
  • Proactively identify researcher efficiency bottlenecks and lead initiatives to improve them, driving long-term roadmaps.
  • Monitor and optimize infrastructure performance for high availability, scalability, and efficient resource utilization.
  • Help define and improve measures of AI researcher efficiency and ensure alignment with measurable results.
  • Collaborate with researchers, data engineers, and DevOps to develop a cohesive AI/ML infrastructure ecosystem.
  • Keep up to date with AI/ML developments and advocate their integration within the organization.

Qualifications

  • BS or similar background in Computer Science or related area (or equivalent experience).
  • 15+ years of demonstrated expertise in AI/ML and HPC tasks and systems.
  • Hands-on experience with HPC-grade infrastructure and accelerated computing (GPU, custom silicon); storage (Lustre, GPFS, BeeGFS); scheduling & orchestration (Slurm, Kubernetes, LSF); high-speed networking (Infiniband, RoCE, Amazon EFA); and containers technologies (Docker, Enroot).
  • Experience supervising and improving distributed training operations using PyTorch (DDP, FSDP), NeMo, or JAX; understanding AI/ML workflows (data processing, model training, inference pipelines).
  • Proficiency in Python, Go, Bash; familiarity with cloud platforms (AWS, GCP, Azure); experience with parallel computing frameworks.
  • Commitment to ongoing learning and staying updated on new technologies in AI/ML infrastructure.
  • Excellent communication and collaboration skills across diverse teams.

Skills

Required:AI/ML infrastructure optimizationHPC systemsDistributed training frameworksContainer technologiesScheduling & orchestrationNetworkingStorage systemsProgramming/scripting

Benefits

  • equity
  • comprehensive benefits package (see company benefits)
Last updated Oct 16, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA