Machine Learning Engineer, Core Evaluations
EuropeFull-timePosted 5mo ago
About the role
Cantina Labs is seeking an experienced Machine Learning Engineer focused on audio model evaluation (speech generation and recognition). You’ll design and implement evaluation pipelines for development and production, build automated dashboards, and lead the evaluation team as a founding member.
Responsibilities
- Designing model evaluation pipelines for models in development and production
- Designing user studies for subjective model evaluations
- Converting requirements into measurable metrics
- Designing and developing automated evaluation dashboard to see model performances and compare results
- Training new models to capture new and different evaluation metrics
- Communicating with the model team to help design better models based on the evaluation results
- Communicating with the data team to help decide the type of data necessary to improve model performance
- Communication with the product-manager to make sure product requirements are correctly measured
- Help grow the evaluation team as the founding member
- Lead the evaluation team in the future
Qualifications
- Strong experience and intuition for designing metrics that capture model performance
- Strong experience with designing user studies on Mechanical Turk or similar platforms
- Strong experience with model training and fine-tuning for model evaluation
- Strong statistical knowledge and experience to statistically compare evaluation results and take decisions
- Very strong engineering and programming skills
- Experience with training ASR, TTS models
- Experience at ML teams working on large-scale machine learning problems (>3B models with >1m hours of data)
Skills
Required:Model evaluation metrics designUser studies designModel training and fine-tuning for evaluationStatistical analysisASR and TTS trainingLarge-scale ML experience
Benefits
- Competitive salary and generous company equity
- Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
- 42 days of paid time off, including: 15 PTO days, 10 sick days, 15 company holidays, 2 floating holidays
- Generous parental leave & fertility support
- 401(k) retirement savings plan
- Lifestyle spending account – $500/month
- Complimentary lunch and snacks for in-office employees
- One Medical membership, and more!
Last updated Oct 14, 2026. Interested? Apply on the company site.
About Cantina
Infinite Creativity Unlocked
Chat with friends and AI. Build characters with personality. Create video in seconds — only on Cantina.
AICreativityVideoCharactersChat
More open roles at Cantina
- Visual Data Curation Specialist1w agoSingapore · Research
- Research Scientist, Real-Time Video Generation1w agoEurope · Research
- Financial Analyst2w agoHybrid (Brooklyn), Hybrid (San Francisco) · Strategy & Operations
- Senior Staff Software Engineer, Search & Recommendation3w agoRemote (U.S. or Canada) · Engineering
- Research Scientist, Video Foundation Models1mo agoCalifornia · Research