← All roles

Senior Deep Learning Software Engineer, Inference

NVIDIA· Engineer, Sys SW
Apply on company site
Santa Clara, CA, Hybrid (Remote - US)$184k - $356.5kFull-timePosted 7mo ago

About the role

Senior Software Engineer focused on Deep Learning Inference to design, build, and optimize GPU-accelerated software for AI model serving and inference, contributing to frameworks like SGLang and vLLM and optimizing performance across NVIDIA accelerators.

Responsibilities

  • Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal and Generative AI.
  • Scale performance of DL models across different architectures and types of NVIDIA accelerators.
  • Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions.
  • Work with cross-collaborative teams across frameworks, NVIDIA libraries and inference optimization innovative solutions.

Qualifications

  • Masters or PhD or equivalent experience in relevant field (Computer Engineering, Computer Science, EECS, AI).
  • 6+ years of relevant software development experience.
  • Excellent C/C++ programming and software design skills. SW Agile skills are helpful and Python experience is a plus.
  • Prior experience with training, deploying or optimizing the inference of DL models in production is a plus.
  • Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus.

Skills

Required:C/C++ programmingSoftware development
Nice to have:PythonPerformance modeling/profilingGPU programmingMulti-GPU communications

Benefits

  • equity
  • benefits (as per company link)
Last updated Sep 11, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA