← All roles

Software Engineer, Model Routing & Inference

Cursor· SpaceXAI / Model Routing & Inference
Apply on company site
OfficeFull-timePosted 6mo ago

About the role

Software Engineer on the Model Routing & Inference team at SpaceXAI, building the inference platform that powers AI interactions across products, including inference gateway, cross-provider failover, and routing/admission control to handle high-throughput, low-latency inference at scale.

Responsibilities

  • Building and evolving the inference gateway to make model onboarding a config change
  • Designing intelligent cross-provider failover so outages do not affect users
  • Designing routing backpressure and admission control to prevent traffic spikes from cascading to providers
  • Handling high-throughput, low-latency distributed systems for inference serving, traffic routing, and real-time data pipelines
  • Shipping production systems that handle millions of requests
  • Making Cursor's AI faster, more reliable, and more cost-effective at scale

Qualifications

  • Deep experience building high-throughput, low-latency distributed systems (inference serving, traffic routing, or real-time data pipelines)
  • Ability to reason about cost/performance tradeoffs at scale (GPU utilization, provider economics, capacity planning)
  • Strong software engineering fundamentals and production-system experience

Skills

Required:High-throughput distributed systemsInference gateway design
Nice to have:Cost/performance optimization

Benefits

  • Not specified in the job description
Last updated Oct 15, 2026. Interested? Apply on the company site.
Cursor logo

About Cursor

The best way to code with AI

Built to make you extraordinarily productive, Cursor is the best way to build software with AI.

AIai-infrastructure-and-developmentai-plg-top-20brex-fastest-growing-2025code completionliquid-ai-recruiting-targetmultimodal agentsproductivity
Company profileWebsite

More open roles at Cursor