← All roles

Senior High-Performance LLM Training Engineer

NVIDIA· Engineer, Sys SW
Apply on company site
Santa Clara, CA$184k - $287.5kfull-timePosted 6mo ago

About the role

Senior engineer focused on performance analysis and optimization for high-performance LLM training workloads, optimizing NVIDIA’s LLM software stack on frameworks like PyTorch and JAX, and contributing to hardware roadmap discussions.

Responsibilities

  • Understand, analyze, profile, and optimize AI training workloads on innovative hardware and software platforms.
  • Understand the big picture of training performance on GPUs, prioritizing and solving problems across all state-of-the-art neural networks.
  • Implement production-quality software in multiple layers of NVIDIA's deep learning platform stack, from drivers to DL frameworks.
  • Build and support NVIDIA submissions to the MLPerf Training benchmark suite.
  • Implement key DL training workloads in NVIDIA's proprietary processor and system simulators to enable future architecture studies.
  • Build tools to automate workload analysis, workload optimization, and other critical workflows.

Qualifications

  • PhD in Computer Science, Electrical Engineering or Computer Engineering and 5+ years; or MS (or equivalent experience) and 8+ years of meaningful work experience.
  • Strong background in deep learning and neural networks, in particular training.
  • Deep background in computer architecture and familiarity with the fundamentals of GPU architecture.
  • Proven experience analyzing and tuning application performance & processor and system-level performance modelling.
  • Programming skills in C++, Python, and CUDA.

Skills

Required:Performance analysis and optimizationC++PythonCUDA

Benefits

  • equity
  • comprehensive benefits package (as listed in NVIDIA benefits)
Last updated Jul 3, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA