← All roles

Site Reliability Engineer, Provider Operations

OpenRouter· Engineering
Apply on company site
Remote$245k - $295kFull-timePosted 1w ago

About the role

OpenRouter is hiring its first AI Inference SRE to own the operational health of provider supply, ensuring endpoints are fast, correct, and available, with rapid detection and automatic failover to protect customer apps.

Responsibilities

  • Provider health and observability. Build and own monitoring for every provider and endpoint: latency, throughput, error rates, uptime, and output correctness. Set SLOs per provider tier and alert on them.
  • Detection and failover. Improve how quickly we detect degraded endpoints, and work with the routing team so traffic shifts away from them automatically.
  • Incident response. Own on-call for provider incidents: triage, mitigate, communicate with providers, run postmortems, and drive follow-ups to closure.
  • Provider accountability. Turn telemetry into scorecards and SLO reporting that providers act on, and be the technical escalation point when a provider's endpoint is misbehaving.
  • Quality regression detection. Build continuous canaries and evals that catch silent regressions (quantization changes, broken tool calling, truncated streams, pricing or usage-reporting mismatches), not just outright downtime.
  • Automate the toil. Replace manual provider-ops work (disabling endpoints, capacity changes, deprecations, rate-limit tuning) with safe, auditable tooling.
  • Capacity and launch readiness. Build tooling to load-test endpoints before big launches so day-zero traffic doesn't take them down.

Qualifications

  • 4+ years in SRE, production engineering, or infrastructure roles running high-traffic, customer-facing systems.
  • Strong with observability tooling and practice: metrics, tracing, logs, SLOs/error budgets, alerting that is always actionable.
  • Capable software engineer who prefers writing tools over executing runbooks. TypeScript and/or Python.
  • Experienced with distributed systems failure modes: timeouts, retries, backpressure, partial outages, noisy neighbors.
  • Calm, clear incident commander who communicates well with external partners under pressure.
  • Understands, or is eager to learn deeply, how LLM inference is served: streaming, tool calling, prompt caching, throughput/latency tradeoffs, and how provider APIs differ.

Skills

Required:Observability and monitoringSoftware engineeringDistributed systems
Last updated Oct 15, 2026. Interested? Apply on the company site.
OpenRouter logo

About OpenRouter

The Unified Interface For LLMs

A router for LLMs and other AI models

ai-infrastructure-and-developmentbrex-fastest-growing-2025wing-list-2026wing-list-2026-mid-stage
Company profileWebsite

More open roles at OpenRouter