AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV
NVIDIA· Architect
Shanghai, Beijing, ShenzhenFull-timePosted 4mo ago
About the role
Software engineering role focused on designing, optimizing, and advancing TensorRT and TensorRT-LLM inferencing software across NVIDIA platforms, collaborating with hardware, software, and research teams to push state-of-the-art AI inference capabilities.
Responsibilities
- Design and develop robust inferencing software (TensorRT/TensorRT-LLM) optimized for functionality and performance across platforms
- Perform performance analysis, optimization, and tuning of deep learning inference workloads
- Track and integrate academic and industry advancements in AI and feature-update TensorRT/TensorRT-LLM accordingly
- Provide feedback into architecture and hardware design and development
- Collaborate across hardware, software, and research teams to shape the direction of machine learning inferencing across NVIDIA platforms
- Own and deliver technical work with scope based on experience, ranging from complex features to substantial parts of larger projects, with increasing independence and technical leadership over time
- Publish key technical results at leading scientific and engineering conferences
Qualifications
- Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics, or related computing-focused field (or equivalent experience)
- Strong Python or C/C++ programming and software design experience, including debugging, performance profiling, and test design
- 2+ years working experience
- Strong curiosity about artificial intelligence and familiarity with the latest developments in deep learning — including generative models, multimodal systems, and large neural networks
- Experience working with deep learning frameworks such as PyTorch, TensorRT/TensorRT-LLM, SGLang or vLLM
- Proactive, self-driven, and able to work independently
- Excellent written and verbal communication skills in English
- Demonstrated ability, commensurate with experience, to take technical ownership, solve complex problems, and contribute effectively in cross-functional environments
Skills
Required:Programming (Python, C/C++)Deep learning frameworksEnglish communication
Last updated Jul 3, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer3d agoEngineer, ASIC
- Senior System Software Engineer, Display Security3d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware3d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer3d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence3d agoHybrid (Remote / Local) · Architect