← All roles

Principal Developer, AI Networking

NVIDIA· Engineer, Sys SW
Apply on company site
Santa Clara, CA, Hybrid (Remote)$272k - $488.8kFull-timePosted 4mo ago

About the role

Senior software engineer focused on profiling, analyzing, and optimizing AI workloads on large-scale GPU/CPU clusters for distributed Deep Learning LLM training and inference, with emphasis on high-performance networking and NVIDIA communication libraries.

Responsibilities

  • Characterizing AI workloads and deep learning models aimed at large-scale LLM training and inference on NVIDIA supercomputers, focusing on distributed systems with high-performance networking and NVIDIA communication libraries
  • Benchmarking, profiling, and analyzing performance to identify bottlenecks and optimization opportunities with emphasis on networking aspects
  • Developing PyTorch trace-based profiling, analysis, and replay tooling to aid benchmarking, debugging, and co-design of network systems for LLM workloads
  • Collaborating with multiple teams from hardware to software to provide performance analysis insights
  • Defining performance test plans, setting performance expectations for new technologies and solutions, and working to achieve performance targets

Qualifications

  • B.Sc in Computer Science or Software Engineering or equivalent experience
  • 15+ years of experience with high-performance networking (RDMA, MPI, NCCL, SHARP)
  • Demonstrated ability in performance evaluation techniques and approaches
  • Experience with NVIDIA GPUs and the CUDA library. Knowledge of deep learning frameworks like TensorFlow or PyTorch. Expertise in networking collective communication libraries such as NCCL and protocols like RoCE and RDMA
  • Fast and self-learning capabilities with strong analytical and problem-solving skills
  • Proficiency in programming languages: Python, Bash, and C++
  • Experience with a container-based development environment
  • Great teammate who communicates clearly and works well with others

Skills

Required:Networking performance evaluationRDMANCCLCUDAPyTorchPythonC++Bash
Nice to have:TensorFlow

Benefits

  • Equity
  • Generous benefits package
Last updated Jul 3, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA