Machine Learning Scientist
Rime· Modeling
RemoteFull-timePosted 3mo ago
About the role
Rime builds voice AI for enterprises with a focus on high-volume speech synthesis and understanding. The role centers on advancing speech synthesis, handling full-/half-duplex multi-modal architectures, and collaborating with linguists to align modeling with frontend behavior.
Responsibilities
- Design, train, and evaluate speech synthesis models, autoregressive and non-autoregressive.
- Drive research on full-duplex and half-duplex multi-modal architectures, including unified S2S systems.
- Choose and iterate on speech representations: neural codecs, semantic tokens, mel features, continuous latents.
- Build rigorous evaluation, objective and perceptual. Hold the bar on quality and prosodic control.
- Collaborate with our linguists on TTS frontend behavior so modeling and frontend choices reinforce each other.
Qualifications
- Deep familiarity with the speech synthesis literature, contemporary and historical — Tacotron, FastSpeech, VITS, VALL-E, the codec-LM lineage.
- Hands-on training with neural codecs (EnCodec, DAC, Mimi, etc.) and multiple representation choices.
- Experience with full- or half-duplex multi-modal modeling (Moshi, LLaMA-Omni, streaming S2S).
- Strong attention to detail on data quality.
- Willing to roll up your sleeves on unglamorous data and training work — paired with the agency to build pipelines so the team isn't stuck doing it by hand.
- Working knowledge of TTS frontend (G2P, normalization, prosody) and experience working with linguists.
- Strong PyTorch fundamentals. Comfortable with training loops, distributed training, model internals.
- PhD or equivalent research experience in speech, audio, ML, or computational linguistics or a track record that makes the credential irrelevant.
Skills
Required:Speech synthesis modelingMulti-modal modelingNeural codecsTTS frontendPyTorchData quality & evaluationResearch & publication
Benefits
- Competitive base + meaningful early-stage equity
- Remote-friendly
- Visa sponsorship available
- Access to a proprietary, full-duplex, studio-quality conversational speech corpus
- Compute and tooling to do the work
- Direct influence on the future of voice AI
Last updated Jul 16, 2026. Interested? Apply on the company site.
About Rime
Rime | Trusted AI voice models for enterprise
AI voice models for enterprise-grade AI TTS focused on pronunciation and multilingual deployment.
AIAI voice modelsBook a callCareersDocsLog inSign upTTS
More open roles at Rime
- Demand Generation2w agoSan Francisco Bay Area · Marketing
- Product Marketing Manager1mo agoHybrid (San Francisco Bay Area) · Marketing
- Founding Account Executive3mo agoSan Francisco Bay Area, New York City · Revenue