Senior Deep Learning Solution Architect
NVIDIA· Architect, Solutions
Beijing, Shanghaifull-timePosted 1mo ago
About the role
Senior Deep Learning Solution Architect at NVIDIA focusing on designing AI computing architectures, optimizing LLM inference/training, and advancing distributed training and heterogeneous computing across on-site locations in Beijing and Shanghai.
Responsibilities
- Contribute to the development of open-source inference frameworks such as SGLang and vLLM, including feature and operator development, performance optimization, and model support, in collaboration with the community.
- Develop and optimize KV cache offloading frameworks for LLM workloads, supporting multi-level cache offloading and reuse across CPU, SSD, and remote storage to improve inference efficiency. (Team project: FlexKV)
- Drive R&D on compute performance in distributed training, and explore methods and technologies for performance optimization.
- Study computational challenges in machine learning systems, identify common needs and bottlenecks, and build example code, acceleration libraries, or frameworks accordingly.
Qualifications
- Over 5 years working experience in the technology industry, with master’s degree or above in computer science, mathematics, electrical engineering, automation, or related fields.
- Strong interest in accelerated computing, parallel computing, and heterogeneous computing, with the motivation to explore these areas in depth.
- Solid programming skills, with a good understanding of data structures and computer systems fundamentals.
- Strong learning agility, adaptability, and the ability to analyze, define, and independently explore technical problems.
Skills
Required:Open-source framework developmentKV cache offloadingDistributed training performanceProblem solving and experimentation
Benefits
- With competitive salaries and a generous benefits package
Last updated Aug 28, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer3d agoEngineer, ASIC
- Senior System Software Engineer, Display Security3d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware3d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer3d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence3d agoHybrid (Remote / Local) · Architect