← All roles

Cyber Evaluations Engineer

Anthropic· Safeguards (Trust & Safety)
Apply on company site
Hybrid (Remote/US locations)$300k - $405kPosted 1mo ago

About the role

Cyber Evaluations Engineer role at Anthropic focused on building and running evaluations to measure cyber-relevant capabilities, safeguarding model robustness, and shaping abuse-detection architecture in collaboration with policy and engineering teams.

Responsibilities

  • Design and run capability, uplift, and safety evaluations to assess cyber-relevant risk in new models
  • Execute per-release safeguard-robustness testing ahead of major model launches
  • Analyze evaluation results and communicate findings clearly to the team and to stakeholders
  • Design, prototype, and tune detection probes for cyber misuse
  • Work with the cyber policy team to turn policy lines into a layered, robust abuse-detection architecture, and measure its precision and coverage over time
  • Build and maintain internal tooling used to run and score evaluations
  • Collaborate with policy and engineering partners to translate eval findings into safeguard improvements

Qualifications

  • Experience building or running evaluations, benchmarks, or test suites for software or ML systems, including delivering results on short, fixed timelines
  • Hands-on cybersecurity experience (e.g., CTF participation, vulnerability research, exploit development, or security research)
  • Proficiency in Python
  • Strong ability to communicate evaluation results with multiple cross-functional stakeholders or potential policy stakeholders

Skills

Required:evaluationscybersecurityPythoncommunication
Last updated Sep 23, 2026. Interested? Apply on the company site.

About Anthropic

building reliable, interpretable, and steerable AI systems

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

ai-infrastructure-and-developmentliquid-ai-recruiting-targetsetter-30setter-30-2026-q1wing-list-2026wing-list-2026-giga-stage
Company profileWebsite

More open roles at Anthropic