← All roles

NIM Solution Architect

NVIDIA· Architect, Solutions
Apply on company site
Shanghai, BeijingOn-sitePosted 4w ago

About the role

Hands-on architect role focusing on NVIDIA Inference Microservices (NIM) for enterprise and industry AI workloads, covering model optimization, inference infrastructure, and customer solution delivery across on-prem, cloud, and hybrid environments.

Responsibilities

  • Drive the implementation, deployment, and optimization of NVIDIA Inference Microservices (NIM) solutions for enterprise and industry AI workloads.
  • Package and serve open-source, NVIDIA, and customer-proprietary models through NIM with standardized, containerized APIs for on-premises, cloud, and hybrid environments.
  • Optimize high-volume inference and rollout workloads for LLMs and VLMs.
  • Evaluate and tune the NIM models.
  • Deliver technical projects, demos and client support tasks as directed by the Solution Architecture Leadership.
  • Provide technical support and guidance to customers, facilitating the adoption and implementation of NVIDIA technologies and products.
  • Collaborate with cross-functional teams to enhance and expand our AI solutions portfolio.

Qualifications

  • Master’s degree or higher in Computer Science, Machine Learning, Electrical Engineering, Mathematics, or a related technical field, or equivalent experience.
  • 2+ years of hands-on experience in machine learning engineering, applied research, LLM/VLM inference, or RL rollout.
  • Production-quality Python and PyTorch skills, including distributed GPU training, solution, profiling, debugging, memory optimization.
  • Working knowledge of transformer architectures, performance optimization, rollout sampling strategies, structured generation, and model-quality evaluation.
  • Strong written and verbal communication skills, with the ability to collaborate effectively across research, engineering, infrastructure, product, and customer-facing teams.

Skills

Required:PythonPyTorchDistributed GPU trainingTransformer architectures

Benefits

  • Not specified in the description
Last updated Sep 25, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA