← All roles

System Software Architect, AI Hardware and Software Performance

NVIDIA· Engineer, Sys SW
Apply on company site
Shanghai, ChinaFull-timePosted 4d ago

About the role

System Software Architect leading PerfLab’s benchmark infrastructure to measure and improve performance for AI/HPC workloads. Combines architecture, hands-on development, cross-team alignment, and production deployment to create scalable, reproducible benchmarking platforms for large language models, agentic AI, and emerging AI workloads.

Responsibilities

  • Define the technical direction and architecture for major areas of PerfLab's benchmark infrastructure, translating evolving business and engineering needs into roadmaps and scalable platform capabilities.
  • Lead the implementation of reusable software, services, and workflows that automate benchmark definition, execution, result collection, validation, and reporting across local, cluster, and cloud-native environments.
  • Establish engineering approaches that improve reliability, scalability, observability, maintainability, and reproducibility of large benchmark campaigns.
  • Stay hands-on with AI benchmarking, analysis, and benchmark design to ground platform investments and technical decisions.
  • Lead delivery across team boundaries: align partner teams on direction, eliminate duplicated efforts, manage delivery risk, and keep stakeholders informed.
  • Raise the engineering bar through architecture and code reviews, technical standards, and mentoring, while evaluating emerging technologies.
  • Contribute to the strategy and development of internal and open-source projects, and grow their adoption.

Qualifications

  • M.Sc. or Ph.D. in Computer Science, Electrical or Computer Engineering from a leading university (or equivalent experience).
  • 10+ years of hands-on experience in developing system software, distributed systems, or AI systems.
  • Strong Python and software engineering expertise, with a track record of building and operating production-quality tools, services, or automation frameworks.
  • Proven technical leadership on sophisticated, multi-functional projects, including defining architecture, managing technical risk, resolving ambiguity, and driving solutions through delivery and adoption.
  • Experience in quantitative analysis of AI hardware and systems, including hardware and system performance, architecture evaluation and power efficiency.
  • Experience in operating distributed or cloud-native systems at scale, including performance profiling, capacity analysis, or resource scheduling.
  • Excellent communication, influence, presentation, and cross-functional coordination skills, with experience aligning teams across countries and time zones to drive decisions.
  • A record of mentoring engineers, raising engineering quality, and helping teams make better technical decisions.

Skills

Required:PythonSystem software developmentDistributed systems / cloud-nativeBenchmark automationCommunication and leadership

Benefits

  • Note: Benefits not explicitly listed in the description.
Last updated Oct 23, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA