← All roles

Senior Software Engineer, NCCL

NVIDIA· Engineer, Sys SW
Apply on company site
Shanghaifull-timePosted 6mo ago

About the role

Senior software engineer role focused on design, implementation, and maintenance of optimized communication runtimes and system software for GPU clusters, contributing to NCCL and related HPC/Deep Learning communication stacks.

Responsibilities

  • Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/Pytorch) and HPC interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters.
  • Participate in and contribute to parallel programming interface specifications like MPI/OpenSHMEM.
  • Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components.
  • Create proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware.

Qualifications

  • M.S./Ph.D. degree in CS/CE or equivalent experience.
  • 5+ years of relevant experience.
  • Excellent C/C++ programming and debugging skills.
  • Strong experience with Linux.
  • Expert understanding of computer system architecture and operating systems.
  • Experience with parallel programming interfaces and communication runtimes.
  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.

Skills

Required:C/C++ programmingLinuxParallel programming interfacesComputer system architecture and operating systemsMPI/OpenSHMEM
Last updated Jul 3, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA