← All roles

Software Engineer - Model API Platform

Sarvam· Engineering
Apply on company site
BengaluruFull-timePosted 1w ago

About the role

Sarvam is building India's full-stack sovereign AI platform. The role focuses on owning major parts of the Model API Platform (ASR, TTS, Vision, LLM, Translate), optimizing end-to-end latency, building real-time pipelines, and mentoring others.

Responsibilities

  • Own one or more major parts of the platform, such as the WebSocket streaming layer, a speech recognition pipeline, or text to speech pipeline: build, operate and improve them.
  • Turn loosely defined goals into RFCs, milestones and shipped results, and write down the decisions and trade-offs.
  • Be accountable after launch: on-call, incident response, root-cause analysis and follow-through on fixes.
  • Make the call when a decision is needed, and own the outcome.
  • Obsessed with latencies, dissecting existing services to understand the system, and tuning the right knobs to optimize performance.
  • Bring services across without regressions in customer-facing APIs, latency or reliability.
  • Build and operate streaming infrastructure: WebSocket connections, long-lived sessions queue-based batch processing, backpressure and low-latency model invocation.
  • Engineer audio pipelines: TTS chunking around model context limits, sample-rate conversion and format encoding, and VAD-based silence detection for ASR.
  • Hold your services to sub-100ms latency SLOs in a multi-tenant environment, and know where every millisecond goes.
  • Reasons from constraints: latency budgets per hop, throughput, cost per request, failure modes and tenant isolation.
  • Use back-of-the-envelope estimates to decide what to build, what to optimize and what to leave alone.
  • Prefer simple designs you can fully explain over clever ones you cannot.
  • Build in observability from day one: logging, metrics and tracing that let anyone debug production quickly.
  • Strengthen the integration testing harness so the team can ship fast without breaking customer-facing APIs.
  • Partner with the Inference and MLOps teams on making model serving fast, reliable and operable.
  • Mentor junior engineers through RFC reviews, code review and pairing.
  • Practice design-first, documentation-first engineering: RFCs before code, no tribal knowledge.

Qualifications

  • 4–6 years of building and operating production backend systems.
  • At least one service you owned end to end under real load, including what broke and what you changed.
  • Strong distributed-systems fundamentals: concurrency, networking, queues, caching, consistency and failure modes.
  • Experience with low-latency or high-throughput services, and comfort reasoning about p95 and p99 latency.
  • Solid fundamentals with a relational database and a cache, such as PostgreSQL and Redis: schema design, query performance and caching strategy.
  • Fluency in at least one backend language and willingness to work in both Python and Golang.
  • Experience running services with containers, CI/CD and production monitoring.
  • Daily, hands-on use of AI tools in your engineering workflow, with concrete examples of what you automated or sped up.
  • A bias for action: fast on reversible decisions, careful on irreversible ones.
  • Clear writing, especially RFCs and design docs that others can act on.

Skills

Required:Backend developmentDistributed systemsLatency optimizationRelational databases and cachingProgramming languagesContainers, CI/CD, production monitoringObservabilityRFCs and design docs
Last updated Oct 13, 2026. Interested? Apply on the company site.
Sarvam logo

About Sarvam

Sarvam | India's Full-Stack Sovereign AI Platform

Sarvam is India's full-stack sovereign AI platform, with speech-to-text, text-to-speech, translation, and conversational agents across 22 Indian languages. Start free.

API PricingAbout UsAksharAryaCareersConversationsDocument DigitisationDocumentation
Company profileWebsite

More open roles at Sarvam