← All roles

Senior Deep Learning Solution Architect

NVIDIA· Architect, Solutions
Apply on company site
Shanghai, BeijingPosted 6mo ago

About the role

Role focused on designing AI computing architectures, optimizing inference/training for LLMs, and accelerating distributed AI workloads across hardware and software stacks.

Responsibilities

  • Contribute to development of open-source inference frameworks such as SGLang and vLLM, including feature and operator development, performance optimization, and model support, in collaboration with the community.
  • Develop and optimize KV cache offloading frameworks for LLM workloads, supporting multi-level cache offloading and reuse across CPU, SSD, and remote storage to improve inference efficiency. (Team project: FlexKV)
  • Drive R&D on compute performance in distributed training, and explore methods and technologies for performance optimization.
  • Study computational challenges in machine learning systems, identify common needs and bottlenecks, and build example code, acceleration libraries, or frameworks accordingly.

Qualifications

  • Over 5 years working experience in the technology industry, with master’s degree or above in computer science, mathematics, electrical engineering, automation, or related fields.
  • Strong interest in accelerated computing, parallel computing, and heterogeneous computing, with the motivation to explore these areas in depth.
  • Solid programming skills, with a good understanding of data structures and computer systems fundamentals.
  • Strong learning agility, adaptability, and the ability to analyze, define, and independently explore technical problems.

Skills

Required:Open-source inference framework developmentKV cache offloadingDistributed training performance optimization
Nice to have:Performance analysis/modeling/optimizationIndependent problem explorationAI coding tools

Benefits

  • With competitive salaries and a generous benefits package, we are widely considered to be one of the world’s most desirable employers! We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our best-in-class engineering teams are rapidly growing.
Last updated Sep 18, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA