AI Computing Software Development Intern - 2027
NVIDIA· Intern
Shanghai, BeijinginternPosted 4w ago
About the role
NVIDIA internship focused on AI computing software development across three tracks: TensorRT LLM inference optimization, TensorRT compiler graph optimization, and CuTe DSL & CUDA kernel development/optimization. On-site opportunities in Shanghai or Beijing, China.
Responsibilities
- Build and enhance high-performance LLM inference pipelines and optimize model execution, scalability, and memory usage (TensorRT LLM track).
- Collaborate across framework and research teams to deliver efficient multi-GPU model serving (TensorRT LLM track).
- Improve graph transformations and code generation for NVIDIA GPUs within the TensorRT compiler backend; develop compiler optimization passes, refine operator fusion and memory allocation (TensorRT Compiler track).
- Collaborate with CUDA and hardware architecture teams (TensorRT Compiler track).
- Design and tune GPU compute kernels and DSL implementations for core deep learning operations (GEMM, MoE, Attention, Convolution); profile, analyze, and improve CUDA kernel performance (CuTe DSL & CUDA Kernels track).
Qualifications
- Pursuing an M.S. or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or related field.
- Excellent problem-solving ability, curiosity for cutting-edge AI systems, and passion for GPU computing and deep learning software performance.
- TensorRT LLM: Strong Python programming and experience with PyTorch; solid understanding of inference and GPU acceleration.
- TensorRT Compiler: Proficient in C++, with experience in compiler or performance optimization.
- CuTe DSL & CUDA Kernels: Skilled in C/C++ and CUDA or parallel programming; familiar with LLVM, MLIR and compiler; understanding of computer architecture and performance profiling/analysis/optimization.
Skills
Required:PythonPyTorchC++CUDA
Nice to have:LLVM / MLIR
Last updated Sep 25, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer3d agoEngineer, ASIC
- Senior System Software Engineer, Display Security3d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware3d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer3d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence3d agoHybrid (Remote / Local) · Architect