← All roles

Software Engineering Intern, NCCL - 2026

NVIDIA· Intern
Apply on company site
Shanghai, BeijinginternPosted 2mo ago

About the role

Internship role in NVIDIA's communication libraries and network software team, focusing on designing, implementing, and maintaining optimized communication runtimes for Deep Learning frameworks and HPC interfaces on GPU clusters, with exposure to MPI/OpenSHMEM, CUDA, and system software interactions.

Responsibilities

  • Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/Pytorch) and HPC programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters.
  • Participating in and contributing to parallel programming interface specifications like MPI/OpenSHMEM.
  • Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components.
  • Creating proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware.

Qualifications

  • You are pursuing a Ph.D. in CE/CS/EE with a strong background in computer architecture, operating systems, communication library and/or AI/ML.
  • Excellent C/C++ programming and debugging skills.
  • Strong experience with Linux.
  • Experience with parallel programming interfaces and communication runtimes.
  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.

Skills

Required:C/C++ programmingLinuxParallel programming interfacesMulti-national teamworkUnderstanding of computer architecture / OS / AI-ML
Last updated Aug 21, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA