Member of Technical Staff - Research, AI Safety
Vals AI· Engineering & Research
San Francisco$130k - $185kFull-timePosted today
About the role
Researcher to design and build AI safety benchmarks to evaluate misalignment in frontier models and agents, leading development of benchmarks and infrastructure to assess real-world misbehavior and safety risks in LLMs and multi-agent systems.
Responsibilities
- Design and develop novel, high-impact benchmarks and environments that assess real-world (mis)behavior, including reward hacking, scheming, deception and other misaligned behavior, in frontier models and agents (including multi-agent systems)
- Conduct research to ensure our benchmarks are valid, reliable, and meaningful
- Collaborate with foundation model labs and enterprises to understand evolving safety evaluation needs
- Analyze model behavior across benchmarks and articulate results
- Publish research findings and contribute to the broader safety and evaluation research communities
- Stay current with the latest developments in LLM capabilities and alignment evaluation methodologies
Qualifications
- Safety experience: Substantial, hands-on work in safety evaluations, monitorability, scheming, deception, or multi-agent safety. You may have worked on an AI safety or alignment team, or done a PhD focused on AI safety. You've published safety research, perhaps papers at leading conferences, or high-quality write-ups.
- Deep ML/AI background: An understanding of neural networks and the fundamentals behind the model training process.
- Strong engineering: Excellent coding skills and the ability to design and build complex evaluation environments yourself, mostly in Python.
- Communication: Ability to clearly communicate complex research ideas to both technical and non-technical audiences.
- Location: We are an in-person team in San Francisco and will support relocation or transportation as needed.
Skills
Required:Safety evaluationsNeural networks and ML fundamentalsPythonCommunication
Benefits
- Relocation and transportation support
- Health/dental insurance coverage
- Lunch and dinner provided, free snacks/coffee/drinks
- Unlimited PTO
- $1,500 housing stipend (within one-mile radius)
- Collaborate with leading AI labs and work on the front lines of AI development and evaluations
- Opportunity to publish and present your work
Last updated Oct 25, 2026. Interested? Apply on the company site.
About Vals AI
Private, domain-specific benchmarks in legal, tax, and finance.
financelawsoftwarehealthcarebenchmarksVals IndexSWE-benchTaxEval
More open roles at Vals AI
- Child & Adolescent Physician / Developmental Expert (Contract)todayRemote · Engineering & Research
- Member of Technical Staff - Research, CybertodaySan Francisco · Engineering & Research
- Technical Content Lead3w agoSan Francisco · Communications
- Marketing Designer1mo agoSan Francisco · Design
- Founding Head of Partnerships (Vals Smith)1mo agoSan Francisco · Vals Smith