← All roles

Inference Engineer

Cartesia· Research
Apply on company site
*HQ - San Francisco, CA$180k - $250kFull-timePosted 11mo ago

About the role

Role focused on designing and building low-latency, scalable model inference and serving stacks for cutting-edge foundation models, with autonomy to shape products and impact AI applications across devices.

Responsibilities

  • Design and build low latency, scalable, and reliable model inference and serving stack for our cutting edge foundation models using Transformers, SSMs and hybrid models.
  • Work closely with our research team and product engineers to serve our suite of products in a fast, cost-effective, and reliable manner.
  • Design and build robust inference infrastructure and monitoring for our products.
  • Have significant autonomy to shape our products and directly impact how cutting-edge AI is applied across various devices and applications.

Qualifications

  • Strong engineering skills, comfortable navigating complex codebases and an eye for writing clean and maintainable code.
  • Experience building large-scale distributed systems with high demands on performance, reliability, and observability.
  • Technical leadership with the ability to execute and deliver zero-to-one results amidst ambiguity.
  • Background in or experience working on inference pipelines with machine learning and generative models.
  • Experience implementing state of the art Machine Learning models and research to applied problems.
  • Preferable: experience with vLLM, SGLang, Continuous Batching or other inference frameworks.
  • Preferable: experience working in CUDA, Triton or similar

Skills

Required:Low-latency model inferenceDistributed systems
Nice to have:CUDA / TritonvLLM / SGLang / Continuous Batching

Benefits

  • Compensation: Competitive base salary alongside attractive equity package.
  • Health Insurance: Fully covered medical insurance along with dental and vision for you and your family.
  • Parental Leave: 9 weeks paternity & 12 weeks maternity leave
  • 401(k)
  • Commuter Allowance: A monthly stipend to help you get to and from the office.
  • Flexible PTO
  • Meals & Snacks: Lunch, dinner and plenty of snacks, provided daily.
  • Your own personal Yoshi
Last updated Jul 15, 2026. Interested? Apply on the company site.

About Cartesia

Real-time TTS API with AI laughter and emotion

Cartesia offers Sonic-3, a streaming text-to-speech API capable of generating natural, expressive voices with laughter in 40+ languages—built for AI agents and interactive applications.

AI voicesinteractive appsliquid-ai-recruiting-targetmultilingualstreaming APItext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at Cartesia