← All roles

Rust Engineer

LiteLLM· Engineering
Apply on company site
Hybrid (San Francisco / Remote (US))$220k - $280k + equityFull-timePosted 2mo ago

About the role

LiteLLM is seeking a Rust Engineer to own the migration of LiteLLM from Python to Rust, with a focus on peak performance and stability. The role is high-visibility and entails planning, structuring, and executing a gradual rollout to achieve the lowest latency and highest throughput for 1B+ requests/month as a single-owner migration.

Responsibilities

  • Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
  • Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
  • Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
  • Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.
  • Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
  • Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.

Qualifications

  • Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.
  • Obsessive about performance. You care about latency and throughput at a level most engineers don't.
  • Strong instinct for stability, with a track record of balancing ambitious change against reliability.
  • Major bonus: prior experience leading codebase migrations from another language to Rust.
  • Major bonus: a demonstrated history of shipping performance-critical systems.
  • Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.

Skills

Required:RustPerformance optimizationSystem design / migration leadership
Nice to have:Backend databases (PostgreSQL, Redis)

Benefits

  • Competitive salary
  • health, dental, and vision benefits
Last updated Sep 23, 2026. Interested? Apply on the company site.
LiteLLM logo

About LiteLLM

Call every LLM API like it's OpenAI [100+ LLMs]

LiteLLM is an open-source LLM Gateway with 18K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund

aiopsartificial-intelligencedeveloper-toolsgenerative-aiopen-source
Company profileWebsite

More open roles at LiteLLM