← All roles

Senior Product Quality Analyst - AI Voice

Spotify· Data and Analytics – Personalization
Apply on company site
LondonPermanentPosted 2mo ago

About the role

Senior role within Spotify’s Voice Production team focused on defining and measuring AI voice quality across products, languages, and use cases, ensuring the technology serves Spotify’s specific needs while aligning with creative and technical standards.

Responsibilities

  • Own the quality bar for Spotify’s AI voice models, defining what “good enough” means for different products, audiences, languages and use cases.
  • Independently design evaluation rubrics and build an evaluation approach that measures naturalness, tone, pacing, pronunciation, accent, audio quality and overall experience.
  • Plan and carry out evaluation campaigns, turning qualitative and quantitative findings into clear recommendations for Voice Production, Speak and product teams.
  • Establish an ongoing evaluation rhythm, including reassessment of model quality as technology and products evolve.
  • Benchmark Spotify’s AI voices against third-party models and competitors to understand leadership, differences, and improvement opportunities.
  • Help determine appropriate quality trade-offs as Spotify expands into additional languages and regions, considering use case and market needs.
  • Partner with voice experts, machine learning teams, product partners and vendors to maintain a consistent quality bar across priorities.
  • Surface meaningful gaps in model performance and influence future research and technical priorities.

Qualifications

  • Experience in product quality, evaluation, data curation or related field involving human judgment to assess model or product performance.
  • Ability to independently define evaluation criteria and turn subjective qualities into repeatable rubrics.
  • Experience designing and running both qualitative and MOS-style evaluations and synthesizing results into actionable insights.
  • Understanding of voice or audio quality (naturalness, pacing, tone, accent, pronunciation) or ability to develop that expertise quickly.
  • Strong judgment to maintain a consistent quality bar while balancing product requirements, markets, and stakeholder perspectives.
  • Comfort working autonomously, establishing processes and cadence to make evaluation useful over time.
  • Clear communication across creative, technical and product teams; reliable point of contact for internal partners and external vendors.
  • Curiosity about generative AI, speech technology and evolving AI voice landscape; ability to translate industry changes into meaningful benchmarks for Spotify.

Skills

Required:Evaluation designQualitative and MOS-style evaluationsVoice/audio quality understandingCross-functional collaboration
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Spotify

Music for everyone

Spotify is a digital music service that gives you access to millions of songs.

music streamingdigital music service
Company profileWebsite

More open roles at Spotify