← All roles

Head of Engineering

LiteLLM· Engineering
Apply on company site
Hybrid (San Francisco)$250k - $300kFull-timePosted 2mo ago

About the role

LiteLLM is seeking a Head of Engineering to lead the team building the leading OSS AI gateway, overseeing engineering productivity, code quality, release health, hiring, and open-source community involvement. Direct line to Head of Engineering and reporting to the founder/CTO. Director-level scope with 100+ provider integrations and ongoing Rust migration.

Responsibilities

  • Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to
  • Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync
  • Drive well-architected, consistent code patterns across the team
  • Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites
  • Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution
  • Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed
  • Look out for the open-source community and protect open-source adoption as the team scales

Qualifications

  • CS/engineering degree or equivalent hands-on engineering background
  • Has worked at a startup, familiar with messy codebases and doing rewrites
  • Been an EM before, with a track record of managing and shipping through a team
  • Metrics-driven with reliability or productivity metrics and experience reducing incident/regression rates
  • Experience handling enterprise escalations and customer-facing accountability
  • Experience in hiring and scaling teams with defined headcount plans
  • Bonus: prior experience at an open-source company; bonus: scaled the engineering team at a fast-growing startup

Skills

Required:Engineering leadershipRoadmapping and program managementIncident and postmortem management
Nice to have:Hiring and team scaling

Benefits

  • Competitive salary
  • Health, dental, and vision benefits
Last updated Sep 23, 2026. Interested? Apply on the company site.
LiteLLM logo

About LiteLLM

Call every LLM API like it's OpenAI [100+ LLMs]

LiteLLM is an open-source LLM Gateway with 18K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund

aiopsartificial-intelligencedeveloper-toolsgenerative-aiopen-source
Company profileWebsite

More open roles at LiteLLM