← All roles

Head of Research

Vals AI· Engineering & Research
Apply on company site
San Francisco$225k - $275kFull-timePosted 3mo ago

About the role

Lead the measurement and evaluation efforts for AI models at Vals AI. Define and advance evaluation methodologies, oversee the research portfolio, publish impactful work, recruit and grow the research team, and collaborate with enterprise customers and lab partners on evaluation challenges.

Responsibilities

  • Advance the science of evaluation. Develop new paradigms for long-horizon, real-world tasks beyond traditional benchmarks.
  • Oversee Vals' broader research portfolio, setting direction across current and future projects.
  • Publish work that moves the field forward and is widely cited.
  • Recruit and grow a research team alongside the founders.
  • Work directly with enterprise customers and lab partners on evaluation problems they have.

Qualifications

  • A PhD in ML/NLP (in progress or completed), or equivalent industry research track record
  • Deep familiarity with the LLM evaluation landscape: benchmarks, failure modes, judge-model approaches, human-in-the-loop methodologies
  • Bias toward research that affects deployment decisions over easily gamed benchmarks
  • Strong written and verbal communication; ability to publish, present, and engage with customers and labs
  • Ability to work in-person in San Francisco.

Skills

Required:ML/NLP researchLLM evaluationCommunication

Benefits

  • Highly competitive salary and equity
  • Relocation and transportation support
  • Collaboration with leading AI labs
  • Health/dental insurance coverage
  • Lunch and dinner provided, free snacks/coffee/drinks
  • 401K plan
  • Unlimited PTO
  • $1,500 housing stipend (within one-mile radius)
Last updated Aug 16, 2026. Interested? Apply on the company site.

About Vals AI

Private, domain-specific benchmarks in legal, tax, and finance.

financelawsoftwarehealthcarebenchmarksVals IndexSWE-benchTaxEval
Company profileWebsite

More open roles at Vals AI