Member of Technical Staff (Speech)
Artificial Analysis· Technical Staff (incl. Product)
San Francisco (On-site)Full-timePosted 1mo ago
About the role
Speech-focused MTI role at Artificial Analysis, responsible for benchmarking and shaping evaluation frameworks across speech modalities, partnering with leading speech AI companies, and publishing influential analysis to steer the industry.
Responsibilities
- Benchmark the Speech Frontier: Own coverage across text to speech, speech to text and speech to speech, benchmarking new models and providers as they launch
- Design Speech Evaluations: Build and extend the evaluation frameworks, prompt libraries and arenas that reflect how developers and creators actually use speech models, including agentic voice through AgentTalk
- Partner with Speech Leaders: Work with the top speech AI companies in the world at a deep technical level to benchmark their models and shape how the industry measures voice
- Publish Influential Analysis: Produce the leaderboards, reports and analysis that shape how the industry understands speech AI progress
- Drive Product Direction: Shape the roadmap of our speech benchmarking platform together with our engineers and pillar lead
- Become AI-Native: Embrace an AI-native workflow, using cutting-edge AI tools to generate leverage in a fast-changing industry and maintain our competitive edge in AI benchmarking
Qualifications
- 3+ years of professional experience, including at least 1 year working hands-on with speech AI
- Strong analytical and critical thinking skills
- Proficiency in Python and data analysis
- Hands-on familiarity with modern speech models and their evaluation: quality assessment, word error rate and latency measurement, and preference testing
- Genuine, demonstrable interest and knowledge of Frontier AI. We want people who have informed opinions about where AI is heading, not just people who use AI tools
Skills
Required:PythonSpeech AI knowledgeData analysis
Benefits
- Competitive compensation including equity
Last updated Oct 1, 2026. Interested? Apply on the company site.
About Artificial Analysis
Independent analysis of AI
AI ModelAPI ProvidersAnalysisBenchmarkingIndependenceEvaluationIntelligence IndexLeaderboards
More open roles at Artificial Analysis
- Member of Technical Staff (Applied AI Research)1mo agoSan Francisco (On-site) · Technical Staff (incl. Product)
- Senior AI / ML Engineer1mo agoMelbourne (On-site) · Engineering
- Member of Technical Staff (Commercial) - Strategy Consulting track1mo agoSan Francisco (On-site) · Technical Staff (incl. Product)
- Forward Deployed Engineer - Language Models1mo agoSan Francisco (On-site), Melbourne (On-site) · Platform & Forward Deployed Engineering
- Senior AI / ML Engineer1mo agoSan Francisco (On-site) · Engineering