← All roles

Staff Engineer

LiteLLM
Apply on company site
Hybrid (San Francisco)$240k - $270kFull-timePosted 2mo ago

About the role

LiteLLM is seeking a Staff Software Engineer to own product quality across testing, CI, and release systems for a platform with 100+ provider integrations. Build conformance testing, CI, and release infrastructure to catch issues before production and maintain fast shipping at scale.

Responsibilities

  • Own product quality end to end and drive regressions toward zero
  • Build a provider conformance test suite covering streaming, tool calling, structured output, error mapping, cost tracking, and auth modes
  • Own CI and release tooling that is fast, deterministic, and trusted enough that a red gate blocks a ship
  • Build canary and synthetic traffic detection to catch upstream provider drift before customers do
  • Own release channels so we ship daily at the edge while enterprise stays stable
  • Do real root cause analysis and turn every escaped defect into a permanent test
  • Raise the engineering bar through code and review, not through process documents

Qualifications

  • Experience at a startup (Seed to Series D) with a willingness to wear multiple hats
  • Built test or release infrastructure for a system with a large external integration surface, or maintained CI for an OSS project with heavy outside contribution
  • Strong debugging depth: can enter an unfamiliar codebase and find real root causes, not just symptoms
  • Opinions about what makes a test suite worth trusting
  • Track record of raising quality on a team without becoming the bottleneck
  • Open source contributions on GitHub or similar

Benefits

  • Competitive salary and benefits
Last updated Sep 23, 2026. Interested? Apply on the company site.
LiteLLM logo

About LiteLLM

Call every LLM API like it's OpenAI [100+ LLMs]

LiteLLM is an open-source LLM Gateway with 18K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund

aiopsartificial-intelligencedeveloper-toolsgenerative-aiopen-source
Company profileWebsite

More open roles at LiteLLM