Engineering Manager, Deep Learning Inference
NVIDIA· Mgmt, Dev Tech SW
Hybrid (Santa Clara, CA), Remote$184k - $287.5kfull-timePosted 2mo ago
About the role
Manager level role leading a Deep Learning Inference Software team at NVIDIA, focusing on GPU-accelerated deployment of AI models, open-source inference frameworks, and end-to-end optimization across NVIDIA accelerators.
Responsibilities
- Lead, mentor, and scale a high-performing engineering team focused on deep learning inference and GPU-accelerated software.
- Drive the strategy, roadmap, and execution of NVIDIA’s inference frameworks engineering, focusing on Client AI.
- Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized inference pipelines across NVIDIA accelerators.
- Oversee performance tuning, profiling, and optimization of large-scale models for LLM, multimodal, and generative AI applications.
- Guide engineers in adopting best practices for CUDA, Triton, CUTLASS, and multi-GPU communications (NIXL, NCCL, NVSHMEM).
- Represent the team in roadmap and planning discussions, ensuring alignment with NVIDIA’s broader AI and software strategies.
- Foster a culture of technical excellence, open collaboration, and continuous innovation.
Qualifications
- MS, PhD, or equivalent experience in Computer Science, Electrical/Computer Engineering, or a related field.
- 6+ overall years of software development experience, including 3+ years in technical leadership or engineering management.
- Strong background in C/C++ software design and development; proficiency in Python is a plus.
- Hands-on experience with GPU programming (CUDA, Triton, CUTLASS) and performance optimization.
- Proven record of deploying or optimizing deep learning models in production environments.
- Experience leading teams using Agile or collaborative software development practices.
Skills
Required:Team leadershipC/C++ software developmentGPU programming
Nice to have:PythonMulti-GPU communications
Benefits
- Equity and comprehensive benefits package.
- Base salary with location-based ranges: Level 2: 184,000 USD - 287,500 USD; Level 3: 224,000 USD - 356,500 USD.
Last updated Aug 7, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer3d agoEngineer, ASIC
- Senior System Software Engineer, Display Security3d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware3d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer3d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence3d agoHybrid (Remote / Local) · Architect