← All roles

Research Engineer, Post-Training Model Evaluations

Anthropic· AI Research & Engineering
Apply on company site
Hybrid (San Francisco, CA), Hybrid (Seattle, WA)$500k - $850kFull-timePosted 5mo ago

About the role

Role focused on evaluating production post-training runs to measure model quality, ensure trustworthy evaluation practices, and inform post-training and release decisions for Anthropic's Claude production models.

Responsibilities

  • Steer the eval strategy for production Claude models: study and optimize the eval mix so it gives the most accurate and complete assessment of model quality
  • Run and monitor the eval fleet live to understand how each Claude model is developing as it trains
  • Advise teams across post-training on eval methodology, and help eval authors bring new evals up to the bar for production
  • Investigate regressions in production runs and inform training interventions when appropriate
  • Build the dashboards, alerts, and reports that researchers and leadership use to track model quality

Qualifications

  • Have designed, run, and analyzed evaluations for ML models at scale
  • Care deeply about measurement quality, thinking twice before trusting a number
  • Can turn ambiguous results into clear recommendations, and are comfortable influencing direction across teams
  • Have strong Python skills and are comfortable working with production systems
  • Maintain clarity and rigor when debugging complex, time-sensitive issues
  • Thrive in controlled chaos and are energized, rather than overwhelmed, when juggling multiple urgent priorities during a live training run
  • Care about the societal impacts of your work and about shipping frontier models responsibly

Skills

Required:Evaluation design and analysis for ML models at scalePythonProduction systemsMeasurement quality and data interpretationCommunication and influencing across teams

Benefits

  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
  • Lovely office space for collaboration
Last updated Sep 30, 2026. Interested? Apply on the company site.

About Anthropic

building reliable, interpretable, and steerable AI systems

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

ai-infrastructure-and-developmentliquid-ai-recruiting-targetsetter-30setter-30-2026-q1wing-list-2026wing-list-2026-giga-stage
Company profileWebsite

More open roles at Anthropic