← All roles

Senior System Software Engineer - GPU Performance

NVIDIA· Engineer, Sys SW
Apply on company site
Hybrid (Remote / Local)$152k - $241.5k + equity + bonusfull-timePosted 7mo ago

About the role

Performance engineer focused on GPU communication libraries (NCCL, NVSHMEM, UCX) to optimize inter-GPU and inter-node communication performance for DL/HPC workloads. Role involves performance characterization, tooling, and cross-team collaboration across multi-GPU, multi-node systems.

Responsibilities

  • Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
  • Study the interaction of our libraries with all HW (GPU, CPU, Networking) and SW components in the stack
  • Evaluate proof-of-concepts, conduct trade-off analysis when multiple solutions are available
  • Triage and root-cause performance issues reported by our customers
  • Collect a lot of performance data; build tools and infrastructure to visualize and analyze the information
  • Collaborate with a very dynamic team across multiple time zones

Qualifications

  • M.S. (or equivalent experience) or PhD in Computer Science, or related field with relevant performance engineering and HPC experience
  • 3+ yrs of experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)
  • Experience conducting performance benchmarking and triage on large scale HPC clusters
  • Good understanding of computer system architecture, HW-SW interactions and operating systems principles
  • Implement micro-benchmarks in C/C++, read and modify the code base when required
  • Ability to debug performance issues across the entire HW/SW stack. Proficient in a scripting language, preferably Python
  • Familiar with containers, cloud provisioning and scheduling tools (Kubernetes, SLURM, Ansible, Docker)
  • Adaptability and passion to learn new areas and tools. Flexibility to work and communicate effectively across different teams and timezones

Skills

Required:Performance characterizationParallel programmingMPI/NCCL/UCX/NVSHMEMC/C++PythonDebugging across HW/SW stack
Nice to have:Containers / Cloud / Scheduling

Benefits

  • equity
  • benefits (see company benefits page)
Last updated Oct 23, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA