← All roles

Member of Technical Staff - Research, Cyber

Vals AI· Engineering & Research
Apply on company site
San Francisco$130k - $185kFull-timePosted today

About the role

Research-focused role to design and build AI benchmarks for cybersecurity, shaping evaluation standards for LLMs and real-world security tasks. Lead development of novel benchmarks, collaborate with labs and enterprise security teams, and publish findings.

Responsibilities

  • Design and develop novel, high-impact benchmarks that assess challenging real-world capabilities for cybersecurity
  • Conduct research to ensure our benchmarks are valid, reliable, and meaningful
  • Collaborate with foundation model labs and enterprise security teams to understand evolving evaluation needs
  • Analyze model performance across benchmarks and articulate results
  • Publish research findings and contribute to the broader security and evaluation research communities
  • Work closely with the infrastructure team to implement your benchmark designs at scale
  • Stay current with the latest developments in LLM cyber capabilities and evaluation methodologies

Qualifications

  • Cybersecurity experience: Hands-on work in security, e.g., as a security engineer, penetration tester, red teamer or vulnerability researcher. You may have found and reported vulnerabilities through bug bounty programs or CVEs.
  • Systems depth: Strong grounding in operating systems, cloud infrastructure and networking.
  • Interest in benchmarking: You care about measuring capability rigorously, not just demonstrating it. Ideally, you've built cyber evals, CTF challenges or security benchmarks before.
  • AI-forward: You already use LLMs in your security work and want to work with them every day.
  • Communication: Ability to clearly communicate complex research ideas to both technical and non-technical audiences.
  • Collaboration: Experience working in research teams and integrating feedback.
  • Location: We are an in-person team in San Francisco and will support relocation or transportation as needed.

Skills

Required:Cybersecurity researchOperating systemsCloud infrastructureBenchmarkingCommunicationCollaboration

Benefits

  • Highly competitive salary and meaningful ownership. Excellence is well rewarded.
  • Relocation and transportation support
  • Health/dental insurance coverage
  • Lunch and dinner provided, free snacks/coffee/drinks
  • Unlimited PTO
  • $1,500 housing stipend (within one-mile radius)
  • Collaborate with leading AI labs and work on the front lines of AI development and evaluations
  • Opportunity to publish and present your work
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Vals AI

Private, domain-specific benchmarks in legal, tax, and finance.

financelawsoftwarehealthcarebenchmarksVals IndexSWE-benchTaxEval
Company profileWebsite

More open roles at Vals AI