← All roles

Software Engineer - Voice AI (Inference Runtime)

Baseten· EPD
Apply on company site
Hybrid (San Francisco), Hybrid (Toronto), Hybrid (New York), Hybrid (Montreal), Hybrid (Seattle)$165k - $330kFull-timePosted 6mo ago

About the role

Senior-level role leading Baseten Voice AI inference stack, building production-grade real-time model serving for STT, TTS, and voice agents, with end-to-end ownership from roadmap to production operations.

Responsibilities

  • Own and lead Voice AI product areas end-to-end - from architecture and system design through implementation, rollout, and long-term production operations.
  • Design, build, and operate real-time, large-scale, high-performance model serving systems for STT, TTS, and voice agent workloads for mission-critical customer deployments
  • Drive cross-team collaboration with sister engineering teams to solve full-stack technical problems, align on priorities, and coordinate end-to-end delivery across the product surface area
  • Mentor teammates through code reviews, design docs, and technical leadership.

Qualifications

  • Bachelor's degree or higher in Computer Science or related field
  • Proven track record owning production-grade real-time, large-scale systems where tail latency (p99) matters.
  • Proficient coding abilities in one or more popular programming or scripting languages; Python proficiency is a plus.
  • Good taste in product, particularly developer-oriented tools
  • Interest in ML/AI infrastructure and willingness to learn
  • Strong collaboration and communication skills
  • Comfortable using AI coding assistants (e.g., Claude Code, Codex, Cursor) as a daily productivity multiplier — as an AI-native company, we see this as a must-have skill.

Skills

Required:Real-time, large-scale model servingSystem architecture and designCollaboration and leadershipProgramming

Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (offices closed from Christmas Eve to New Year’s Day)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering learning and networking opportunities.
Last updated Oct 21, 2026. Interested? Apply on the company site.
Baseten logo

About Baseten

Inference is everything

Effortlessly serve optimized open source & custom models on the fastest, most reliable model delivery network.

AICloud InfrastructureDeveloper ToolsInference PlatformMachine LearningModel DeploymentModel Runtimesai-infrastructure-and-development
Company profileWebsite

More open roles at Baseten