Senior HPC and AI Network Software Architect
NVIDIA· Architect
Zurichfull-timePosted 1mo ago
About the role
Senior HPC and AI Network Software Architect responsible for building scalable AI infrastructure, focusing on distributed training, real-time inference, and communication efficiency across large systems. Collaborates with researchers and engineers to design software/hardware for AI at scale, integrating with AI frameworks and platform teams.
Responsibilities
- Build and evolve the architecture of scalable software systems for distributed AI training and inference, focusing on throughput, latency, resiliency, and memory efficiency across cluster-scale deployments.
- Develop and evaluate next-generation communication and runtime capabilities in libraries such as NCCL, UCX, and UCC, tailored to frontier AI workloads.
- Partner with AI framework teams (e.g., TensorFlow, PyTorch, JAX) and internal platform teams to build integrations, explore new approaches, and improve end-to-end performance and reliability.
- Collaborate on hardware and system-level features across GPUs, DPUs, and interconnects to speed up data movement and enable new capabilities for training, inference, and model serving at scale.
- Drive innovation across runtime systems, communication libraries, and AI-specific protocol layers, turning new ideas into practical capabilities and robust implementations.
Qualifications
- Ph.D., or equivalent industry experience, in computer science, computer engineering, or a closely related field.
- 5+ years of experience in systems programming, parallel or distributed computing, high-performance networking, or large-scale data movement, including experience designing and building complex systems.
- Strong programming background in C++, Python, and ideally CUDA or other GPU programming models, with a track record of building production-quality performance-critical software.
- Extensive hands-on experience with AI frameworks (e.g., PyTorch, TensorFlow, JAX) and a solid grasp of how communication libraries and runtime systems facilitate large-scale training and inference.
- Demonstrated success in developing and refining high-throughput, low-latency systems, including the ability to reason across software stacks, hardware capabilities, and system bottlenecks.
- Strong collaboration skills in a multi-national, interdisciplinary setting, with the ability to contribute ideas, build momentum, and work effectively with senior engineers, researchers, and partner teams.
Skills
Required:C++Python
Nice to have:CUDANCCL/UCX/UCC
Benefits
- Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. See www.nvidiabenefits.com for details.
Last updated Sep 4, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer3d agoEngineer, ASIC
- Senior System Software Engineer, Display Security3d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware3d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer3d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence3d agoHybrid (Remote / Local) · Architect