← All roles

Research Engineer, Audio and Speech

Decagon· Engineering
Apply on company site
San Francisco, New York City$200k - $400kFull-timePosted 1mo ago

About the role

Research Engineer focused on Audio and Speech responsible for building models and agent harnesses powering Decagon’s real-time voice agents, from idea to production, advancing multimodal and full-duplex systems for listen-reason-speak interactions.

Responsibilities

  • Design and build next-generation agent harnesses optimized for streaming speech, turn-taking, interruptions, overlapping speech, and continuous interaction
  • Research and train multimodal and full-duplex models that jointly understand audio, reason, and generate speech
  • Improve speech recognition, voice activity detection, endpointing, and speech generation across diverse speakers, environments, domains, and languages
  • Build evaluations and use production calls to ship measurable improvements in accuracy, latency, naturalness, and task outcomes
  • Optimize end-to-end inference for responsiveness, throughput, stability, and cost, partnering with Voice Platform and Infrastructure teams to deploy at scale

Qualifications

  • 2+ years of experience in speech, audio ML, multimodal ML, or production machine learning
  • Experience developing or adapting autoregressive, diffusion, flow-matching, or codec-based speech models
  • Hands-on experience with streaming agent systems, low-latency inference, production model serving, and evaluation on real-world audio
  • Fluency in Python and a modern deep-learning framework such as PyTorch, with strong foundations in machine learning and signal processing
  • A track record of taking research ideas from prototype to reliable, measurable production impact

Skills

Required:Speech and audio MLAutoregressive / diffusion / codec-based speech modelsStreaming agent systemsPython / PyTorchProduction ML deployment

Benefits

  • Medical, Dental, and Vision benefits for you and your family
  • Life Insurance and Disability Benefits
  • Retirement Plan (e.g., 401K, pension)
  • Parental Leave
  • Fertility and family building benefits through Carrot
  • Monthly stipend to support your wellness, lifestyle, and work-life balance
  • Daily lunches and snacks in the office
  • Take what you need vacation policy (subject to local requirements; UK employees receive 25 days of statutory leave)
Last updated Sep 9, 2026. Interested? Apply on the company site.

About Decagon

Conversational AI for Customer Experience

Reimagine your customer experience with AI agents, built for the enterprise.

AI agentsCXConversational AICustomer Experienceai-agents-and-applicationsorchestrationvoice-ai-stackwing-list-2026
Company profileWebsite

More open roles at Decagon