← All roles

Product Engineer

LiteLLM· Engineering
Apply on company site
Hybrid (San Francisco)$200k - $260kFull-timePosted 2mo ago

About the role

LiteLLM is seeking a Product Engineer to work directly with the founders to understand customer needs, design solutions, and ship features across backend, frontend, and developer tooling. The role blends product and software engineering, with end-to-end ownership from idea to production for LiteLLM’s second major product.

Responsibilities

  • Build new product features from concept to production.
  • Work directly with customers to understand pain points and validate solutions.
  • Ship quickly while maintaining a high quality bar.
  • Prototype new ideas and iterate based on user feedback.
  • Own major product areas and continuously improve them over time.
  • Design backend APIs and services using Python and FastAPI.
  • Build intuitive developer experiences across our API, dashboard, and CLI.
  • Collaborate directly with the founders on product direction and technical decisions.
  • Help define and build LiteLLM's second major product.

Qualifications

  • Bachelor's or Master's degree in Computer Science or a related field.
  • Strong software engineering fundamentals.
  • Experience building production software, preferably with Python.
  • Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
  • Strong product intuition and curiosity about how customers use software.
  • Excellent written and verbal communication.
  • High ownership—you naturally identify problems and solve them without waiting to be asked.
  • Comfortable operating in ambiguity and making decisions with incomplete information.
  • Excited by shipping quickly and learning from real users.

Skills

Required:PythonFastAPIBackend API designCustomer interviewing / product discoveryCommunication
Nice to have:Frontend development

Benefits

  • Competitive salary, equity, health, dental, and vision benefits.
Last updated Sep 23, 2026. Interested? Apply on the company site.
LiteLLM logo

About LiteLLM

Call every LLM API like it's OpenAI [100+ LLMs]

LiteLLM is an open-source LLM Gateway with 18K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund

aiopsartificial-intelligencedeveloper-toolsgenerative-aiopen-source
Company profileWebsite

More open roles at LiteLLM