← All roles

Senior HPC Cluster Engineer - AI, ML

NVIDIA· Engineer, Sys SW
Apply on company site
Hybrid (Bengaluru, Pune, Remote - India)Full-timePosted 2mo ago

About the role

Senior AI/ML HPC Cluster Engineer to design, deploy, and manage large-scale AI/HPC infrastructure (on-prem and cloud) for research and development on NVIDIA's Managed AI Superclusters (MARS) team.

Responsibilities

  • Provide leadership in systems administration and service delivery on the AI/HPC fleet by coordinating system upgrades, responding to incidents, and delivering reliability improvements.
  • Collaborate closely with global teams to deliver a world class user experience in AI and HPC research.
  • Own day-to-day operations of production AI/HPC clusters, ensuring system health, user satisfaction, and efficient resource utilization.
  • Develop and improve ecosystem around GPU-accelerated computing including scalable automation solutions.
  • Build and maintain heterogeneous AI/ML clusters on-premises and in the cloud.
  • Create and cultivate customer and cross-team relationships to meet evolving user needs.
  • Support researchers to run workloads including performance analysis and optimizations
  • Analyze and optimize cluster efficiency, job fragmentation, and GPU waste to meet internal SLA targets.
  • Conduct root cause analysis and suggest corrective action; proactively fix issues before they occur.
  • Lead SEV triage and postmortems for reliability incidents affecting users or infrastructure.
  • Participate in on-call rotation and incident response for critical production GPU clusters.

Qualifications

  • Bachelor’s degree in Computer Science, Electrical Engineering or related field or equivalent experience
  • Minimum 5 years of experience designing and operating large scale compute infrastructure
  • Experience with AI/HPC advanced job schedulers, such as Slurm, K8s, PBS, RTDA, BCM, or LSF
  • Proficient in administering Centos/RHEL and/or Ubuntu Linux distributions
  • Solid understanding of cluster configuration management tools (BCM, Terraform, Ansible, Puppet, Salt, etc.), container technologies (Docker, Singularity, Podman, Shifter, Charliecloud), Python programming, and bash scripting
  • Applied experience with AI/HPC workflows that use MPI
  • Experience analyzing and tuning performance for a variety of AI/HPC workloads
  • Passion for continual learning and staying ahead of emerging technologies and effective approaches in the HPC and AI/ML infrastructure fields.

Skills

Required:AI/HPC schedulingLinux system administrationConfiguration managementContainer technologiesPython and Bash scriptingMPI

Benefits

  • Not specified in description
Last updated Aug 7, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA