Research Scientist, Frontier Risk Evaluations
About the role
Research Scientist focused on Frontier Risk Evaluations at Scale Labs, designing evaluation measures, harnesses and datasets to measure risks posed by frontier AI systems and coordinating with government agencies, labs and policymakers.
Responsibilities
- Design and build harnesses to test AI models and systems (including agents) for dangerous capabilities such as security vulnerability exploitation, CBRN uplift, and other high-risk activities
- Work with government agencies or other labs to collectively scope and design evaluations to measure and mitigate risks posed by advanced AI systems
- Publish evaluation methodologies and write technical reports for policymakers
Qualifications
- Commitment to mission of promoting safe, secure, and trustworthy AI deployments in frontier AI
- Practical experience conducting technical research collaboratively; comfortable building and instrumenting ML pipelines, writing evaluation harnesses, and turning ideas into prototypes
- A track record of published research in machine learning, particularly in generative AI
- At least three years of experience addressing sophisticated ML problems in research or product development
- Strong written and verbal communication skills for cross-functional collaboration
Skills
Benefits
- comprehensive health, dental and vision coverage
- retirement benefits
- learning and development stipend
- generous PTO
- commuter stipend (potentially eligible)
About Scale AI
Data-centric infrastructure to accelerate the development of AI
Scale accelerates the development of AI within organizations of any size to deliver critical business insights and operational efficiency. Its data-centric infrastructure platform leverages RLHF (Reinforced Learning with Human Feedback) to help organizations build the strongest AI models that supercharge their business, with customers across industries including Meta, Microsoft, U.S. Army, DoD’s Defense Innovation Unit, Open AI, General Motors, Toyota Research Institute, Brex, Instacart and Flexport.
More open roles at Scale AI
- Strategic Contracts Lead, Public Sector6d agoWashington, DC · Public Sector
- Web Designer, Brand Web Experience6d agoSan Francisco, CA · Marketing
- Head of Strategic Partnerships, Global Systems Integrators6d agoSan Francisco, CA · Enterprise Sales
- Safety Research Scholar - Human Frontier Labs6d agoHybrid (United States) · Human Frontier Collective
- Machine Learning Research Intern (Summer 2027)6d agoHybrid (San Francisco, CA), Hybrid (New York, NY) · University