Senior Software Engineer, NCCL
NVIDIA· Engineer, Sys SW
Santa Clara, CA$152k - $241.5kfull-timePosted 7mo ago
About the role
Senior software engineer role focused on design, implementation, and maintenance of optimized communication runtimes for Deep Learning frameworks and HPC interfaces, contributing to MPI/OpenSHMEM specifications, and enabling GPU interactions within heterogeneous computing systems.
Responsibilities
- Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/Pytorch) and HPC programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters.
- Participating in and contributing to parallel programming interface specifications like MPI/OpenSHMEM.
- Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components.
- Creating proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware.
Qualifications
- M.S./Ph.D. degree in CS/CE or equivalent experience.
- 5+ years of relevant experience.
- Excellent C/C++ programming and debugging skills.
- Strong experience with Linux.
- Expert understanding of computer system architecture and operating systems.
- Experience with parallel programming interfaces and communication runtimes.
- Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.
Skills
Required:C/C++ programmingLinuxParallel programming interfacesSystem software for GPU interactions
Benefits
- equity
- comprehensive benefits package
- base salary and location-based compensation
- inclusive work environment
Last updated Oct 23, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer4d agoEngineer, ASIC
- Senior System Software Engineer, Display Security4d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware4d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer4d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence4d agoHybrid (Remote / Local) · Architect