← All roles

Infrastructure SRE - HPC

Sarvam· Infrastructure
Apply on company site
Bengaluru, ChennaiFull-timePosted 3mo ago

About the role

SRE role focused on managing a large, multi-vendor GPU fleet for both training and inference workloads. Requires depth in at least one focus area (storage, fabric, GPU systems reliability, Kubernetes platform reliability, or training/inference workload reliability) with broad fluency across the others. Not a Kubernetes administration role; emphasis on deep infrastructure reliability above/below Kubernetes.

Responsibilities

  • Operate the GPU fleet end to end across training and serving - provisioning, observability, capacity, and fleet health.
  • Hold a meaningful on-call rotation, write runbooks that hold up under pressure, and drive postmortems that produce durable fixes.
  • Build the internal tooling the team relies on, rather than operating off-the-shelf systems alone.
  • Partner with ML and platform teams to keep large runs alive and serving latency predictable.

Qualifications

  • 5+ years in infrastructure or site reliability engineering, including 2+ years operating GPU clusters at scale.
  • Demonstrated on-call ownership of infrastructure that mattered, with a track record of postmortems that led to real change.
  • Proficiency in Python or Go, used to build and maintain internal tooling.
  • Working fluency across all five areas of focus below - enough to recognize, triage, and route a problem outside your specialty, even if the fix belongs to a teammate.

Skills

Nice to have:Distributed high-performance storageFabric & RDMA networkingGPU systems reliabilityKubernetes platform reliabilityTraining & inference workload reliability
Last updated Jul 14, 2026. Interested? Apply on the company site.
Sarvam logo

About Sarvam

Sarvam | India's Full-Stack Sovereign AI Platform

Sarvam is India's full-stack sovereign AI platform, with speech-to-text, text-to-speech, translation, and conversational agents across 22 Indian languages. Start free.

API PricingAbout UsAksharAryaCareersConversationsDocument DigitisationDocumentation
Company profileWebsite

More open roles at Sarvam