← All roles

Principal Architect, AI Networking

NVIDIA· Architect
Apply on company site
Hybrid (Remote / Local)$272k - $431.3kFull-timePosted 6mo ago

About the role

Applied research leader shaping the architectural direction for NVIDIA’s AI systems networking at scale, translating research breakthroughs into production-grade software across GPUs, DPUs, NICs, and heterogeneous storage.

Responsibilities

  • Setting the long-term technical vision for distributed AI communication systems—GPU-to-GPU, GPU-to-storage, and cross-node data movement
  • Conducting original research and prototyping next-generation networking solutions over RDMA, NVLink, and GPUDirect
  • Driving hardware-software co-optimization with GPU, DPU, NIC, and network switch; investigating bottlenecks in communication runtimes for large-scale AI workloads (KV cache transfer, disaggregated prefill/decode, model parallelism)
  • Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM
  • Publishing findings, representing NVIDIA in industry forums and standards bodies, and mentoring senior engineers across the organization

Qualifications

  • 15+ years in systems software and/or networking with deep expertise in high-performance networking (InfiniBand, RoCE, RDMA, NVLink), communication libraries (e.g. NIXL, NCCL, UCX, MPI, NVSHMEM), and GPU accelerated systems, with track record of defining and delivering complex, cross-team technical initiatives from research concept to production
  • MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field
  • Deep understanding of computer architecture, memory hierarchies, DMA engines, and OS-level networking
  • Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns
  • Proficiency in programming languages such as C, C++, Rust and Python

Skills

Required:High-performance networkingGPU accelerated systemsProgramming languages
Nice to have:ML systems concepts

Benefits

  • Equity
  • comprehensive benefits package
Last updated Jul 3, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA