← All roles

AI Engineer

LiteLLM· Engineering
Apply on company site
Hybrid (San Francisco)$170k - $220kFull-timePosted 2mo ago

About the role

LiteLLM is seeking an AI Engineer to unify and transform LLM API calls across 100+ providers, building a provider-agnostic interoperability layer and shaping the developer experience for LiteLLM’s gateway and Python SDK.

Responsibilities

  • Ensure LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec.
  • Write transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats.
  • Build provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API).
  • Collaborate with CEO and CTO on critical projects including system design for provider-level features at the gateway level (skills, compaction, batches).
  • Think about developer experience to support millions of users via LiteLLM's Python SDK.
  • Build across LLMs, MCPs, and Agents maintaining an LLM interoperability layer and supporting various MCP Auth flows.

Qualifications

  • 1-2 years of backend/full-stack experience with production systems
  • Passion for open source and user engagement
  • Experience working with the OpenAI API (understand /chat/completions vs /responses and API nuances)
  • Strong work ethic and ability to thrive in small teams
  • Eagerness to talk to users and solve real problems

Skills

Required:PythonLLM APIsFastAPI

Benefits

  • Competitive salary
  • equity
  • health, dental, and vision benefits
Last updated Sep 23, 2026. Interested? Apply on the company site.
LiteLLM logo

About LiteLLM

Call every LLM API like it's OpenAI [100+ LLMs]

LiteLLM is an open-source LLM Gateway with 18K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund

aiopsartificial-intelligencedeveloper-toolsgenerative-aiopen-source
Company profileWebsite

More open roles at LiteLLM