Research Scientist - Frontier Benchmarks
Snorkel AI· 316 - Research
Hybrid (New York City, NY; San Francisco, CA; United States)$200k - $375kFull-timePosted 4mo ago
About the role
Role focused on designing next-generation benchmarks and datasets to evaluate frontier models, translating insights into customer-facing narratives, and driving production integration across cross-functional teams.
Responsibilities
- Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships
- Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert-curated data for customer-facing presentations, technical reports, and go-to-market materials
- Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap
- Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows
- Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI
Qualifications
- Strong research background in AI/ML evaluation, NLP, or related fields, with a track record of rigorous experimental design — especially around measuring the impact of training and evaluation data on model behavior
- Exceptional communication skills — able to present complex technical findings clearly to both technical and non-technical audiences
- Comfort operating in a fast-moving, cross-functional environment with ambiguous problem spaces
- Genuine interest in GTM strategy, startup dynamics, and the commercial side of AI data services
- Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered.
Skills
Required:AI/ML evaluationCommunicationCross-functional collaboration
Nice to have:Research publication and outreach
Last updated Sep 30, 2026. Interested? Apply on the company site.
About Snorkel AI
Shaping how AI learns through better data
Snorkel AI delivers the highest quality specialized datasets for frontier LLMs and enterprise models.
AI data development servicesAboutApplied AI solutionsCareersCompanyContact usCustomer storiesData development services
More open roles at Snorkel AI
- Finance Manager, DaaS4d agoHybrid (San Francisco, CA) · 532 - Finance Ops
- Senior Operations Manager, Enablement - Delivery4d agoHybrid (New York City, NY), Hybrid (San Francisco, CA) · 510 - DaaS G&A
- Engineering Manager, Federal & Regulated Infrastructure4d agoHybrid (San Francisco Bay Area), Hybrid (New York) +1 more · 312 - Engineering
- Corporate FP&A Manager1w agoHybrid (San Francisco, CA) · 532 - Finance Ops
- Research Fellow2w agoHybrid (New York City, NY; San Francisco, CA) · 316 - Research