← All roles

AI Red Teamer, CBRNE (Remote)

Handshake· General & Administrative
Apply on company site
Remote$65/hr - $158/hrContractPosted 1mo ago

About the role

Role evaluating AI models for handling CBRNE-related queries, probing safety guardrails, and documenting failures to improve model safety. Remote contract position with emphasis on domain expertise in CBRNE and adversarial evaluation.

Responsibilities

  • Design technically grounded adversarial prompts that test whether models provide meaningful uplift toward CBRNE threats
  • Evaluate model outputs for technical accuracy, assessing whether responses contain genuinely dangerous information versus superficial or publicly available knowledge
  • Probe dual-use knowledge boundaries, testing how models handle queries that blend legitimate scientific, medical, or industrial use cases with potential weapons applications
  • Test multi-step and multi-turn attack chains that simulate how a motivated actor might extract dangerous information incrementally
  • Score model responses against structured harm taxonomies and severity rubrics calibrated to real-world risk
  • Document findings with clear technical reasoning, including what a response gets right, what it gets wrong, and why the failure matters
  • Identify and articulate the difference between information that is freely available in open literature and information that constitutes genuine uplift beyond baseline
  • Contribute to the development and refinement of CBRNE-specific evaluation frameworks and threat models
  • Collaborate with other red teamers, AI researchers, and policy teams to translate findings into actionable model improvements
  • Stay current on evolving model capabilities, jailbreak techniques, and relevant developments in your domain

Qualifications

  • Graduate-level education or equivalent professional experience in a relevant CBRNE field (chemistry, biochemistry, microbiology, virology, nuclear physics, radiochemistry, materials science, munitions/ordnance, chemical engineering, or closely related disciplines)
  • Ability to evaluate the technical accuracy and real-world consequence of model outputs in your domain
  • Understanding of dual-use research concerns and the distinction between open-source knowledge and operationally significant uplift
  • Strong hands-on experience using multiple LLMs (ChatGPT, Claude, Gemini, open-source models, etc.)
  • Creative, adversarial problem-solving skills
  • Clear and precise written communication, including the ability to explain technical risk to non-specialist audiences
  • Strong ethical judgment and the ability to separate adversarial thinking from personal values
  • Self-directed, collaborative, and comfortable in feedback-heavy environments

Skills

Required:Domain-specific CBRNE expertiseAdversarial thinking and red-teamingTechnical evaluation of model outputs
Last updated Oct 22, 2026. Interested? Apply on the company site.
Handshake logo

About Handshake

Careers start here

The better career platform for Gen Z changing how, where, and why the next generation of talent builds their career.

educationcareer platformtalent acquisitionstudent engagement
Company profileWebsite

More open roles at Handshake