← All roles

Staff Engineer, API Platform

Sarvam· Engineering
Apply on company site
BengaluruFull-timePosted 3mo ago

About the role

Sarvam is building the bedrock of Sovereign AI for India. The Staff Engineer will own the API platform end-to-end, oversee the Python→Go rewrite, and drive architecture, reliability, and performance for multi-tenant, low-latency model APIs across ASR, TTS, Vision, LLM, and Translate.

Responsibilities

  • The end-to-end design and evolution of the platform, from the moment a request hits the edge to the response that goes back out
  • The Python→Go rewrite: leading the architecture, setting the patterns, and bringing the platform across without compromising reliability
  • Audio pipeline engineering: TTS chunking around model context limits, sample-rate adjustments and format encoding, VAD-based silence detection for ASR
  • Vision pipelines: orchestrating OCR, layout detection, and VLM harnesses for structured data extraction
  • Streaming infrastructure: WebSocket connections, queue-based batch processing, back pressure, low-latency model invocation
  • The commercial layer: metering, billing, prepaid wallet management, and rate-limiting, engineered to the same bar as the model APIs themselves
  • Performance and reliability for a multi-tenant platform operating at sub-second latency SLOs
  • Observability (logging, metrics, tracing), so the team can debug production confidently and quickly
  • Integration testing infrastructure: the harness that lets us ship fast without breaking customer-facing APIs
  • Close partnership with the Inference and MLOps teams, mentoring them on production engineering so model serving is fast, reliable, and operable
  • Design-first, documentation-first engineering culture within the team: RFCs before code, decisions written down, no tribal knowledge

Qualifications

  • 7+ years building production backend systems at scale
  • Strong Go in production: you've designed, built, and operated Go services under real load
  • Comfortable in Python: you'll work in both languages through the rewrite, and FastAPI is the current foundation
  • A track record of designing and operating high-scale, low-latency, multi-tenant distributed systems
  • Hands-on experience with real-time / streaming systems: WebSockets, long-lived connections, backpressure
  • Strong PostgreSQL and Redis fundamentals: schema design, query performance, caching strategy
  • Comfort running services on Kubernetes in production
  • The judgment of a senior IC: when to build vs. buy, when to optimize vs. ship, when to abstract vs. inline, and how to bring others up with you

Skills

Required:GoPythonPostgreSQLRedisKubernetesWebSockets

Benefits

  • Not specified in the description
Last updated Jul 14, 2026. Interested? Apply on the company site.
Sarvam logo

About Sarvam

Sarvam | India's Full-Stack Sovereign AI Platform

Sarvam is India's full-stack sovereign AI platform, with speech-to-text, text-to-speech, translation, and conversational agents across 22 Indian languages. Start free.

API PricingAbout UsAksharAryaCareersConversationsDocument DigitisationDocumentation
Company profileWebsite

More open roles at Sarvam