← All roles

Director, Research - Evaluation & Training

Snorkel AI· 316 - Research
Apply on company site
Hybrid (New York City, NY; San Francisco, CA; United States)$275k - $425kfull-timePosted 4mo ago

About the role

Director level role leading a research team focused on data evaluation, error analysis, and data valuation to predict model performance and inform Snorkel's data strategy, benchmarks, and datasets.

Responsibilities

  • Own a multi-quarter roadmap centered on novel evaluation, error analysis, and data valuation techniques
  • Synthesize and share trends from model-failure analysis and benchmarking into recommendations on the datasets the community should focus on and the ones Snorkel should invest in
  • Focus on data valuation techniques that quantify how Snorkel data meaningfully improves model performance
  • Lead and grow a team of researchers, setting a high bar for quality, rigor and speed of execution
  • Act as the primary bridge between the team's findings and Product, GTM, and our customers

Qualifications

  • 7+ years in applied AI, ML, or research roles, with 4+ years managing technical teams.
  • A leader who has repeatedly turned research and analysis into business outcomes, and who instinctively connects technical findings to market and customer needs.
  • Strong business and market judgment in the AI/ML space — understanding competitive and frontier-lab landscape and prioritization.
  • Technically conversant and credible: depth in LLM evaluation, benchmarking, and model behavior analysis to set direction and judge experimental quality.
  • A nose for trends: ability to extract signal across evaluation results and failure cases to drive what gets built next.
  • Excellent communication and storytelling skills for non-research audiences.
  • Familiarity with data valuation or data attribution research is a strong plus.
  • Bonus: experience with frontier labs, public benchmarks, or commercial AI data/eval products.

Skills

Required:Data evaluationError analysisBenchmarkingTeam leadershipCommunication & storytelling

Benefits

  • Salary range: $275,000—$425,000 USD
Last updated Sep 30, 2026. Interested? Apply on the company site.

About Snorkel AI

Shaping how AI learns through better data

Snorkel AI delivers the highest quality specialized datasets for frontier LLMs and enterprise models.

AI data development servicesAboutApplied AI solutionsCareersCompanyContact usCustomer storiesData development services
Company profileWebsite

More open roles at Snorkel AI