AI Red Teamer (Seattle)
Seattle, WA$32/hr - $95/hrFull-timePosted 1mo ago
About the role
AI Red Teamer to stress-test large language models by designing adversarial prompts to expose vulnerabilities across safety, bias, guardrails, and robustness. Generalist role spanning text, image, voice, and agentic capabilities with responsibilities in experimentation, documentation, and collaboration with engineers and researchers.
Responsibilities
- Craft creative prompts and multi-turn scenarios to stress-test AI guardrails across diverse risk categories
- Discover ways around safety filters, restrictions, and defenses using jailbreak, evasion, and prompt injection techniques
- Explore edge cases to provoke disallowed, harmful, or incorrect outputs
- Evaluate and score model responses against structured harm taxonomies and severity rubrics
- Document experiments clearly, including what you tried, why you tried it, and what it revealed
- Review and refine adversarial prompts generated by other team members
- Contribute to harm taxonomy development, calibration exercises, and inter-rater reliability work
- Collaborate with engineers, data scientists, and researchers to share findings and strengthen defenses
- Work with potentially disturbing content on a regular basis (see Content Warning below)
- Stay current on jailbreaks, attack methods, and evolving model behaviors
Qualifications
- Strong hands-on experience using multiple LLMs (ChatGPT, Claude, Gemini, open-source models, etc.)
- Intuition for crafting adversarial prompts; familiarity with jailbreak or evasion techniques is a strong plus
- Creative, adversarial problem-solving skills
- Clear and thoughtful written communication
- Strong ethical judgment and the ability to separate adversarial thinking from personal values
- Self-directed, collaborative, and comfortable in feedback-heavy environments
- Curiosity, persistence, and comfort with frequent failure in experimentation
Skills
Required:Adversarial prompt craftingLLM model evaluationDocumentation and reporting
Benefits
- Not specified in the description
Last updated Oct 22, 2026. Interested? Apply on the company site.
About Handshake
Careers start here
The better career platform for Gen Z changing how, where, and why the next generation of talent builds their career.
educationcareer platformtalent acquisitionstudent engagement
More open roles at Handshake
- Privacy Associate4d agoSan Francisco, CA · General & Administrative
- Seattle Site Lead4d agoSeattle, WA · HAI Delivery Ops
- Senior Recruiter4d agoSan Francisco, CA · General & Administrative
- Director, Product Marketing4d agoHybrid (San Francisco, CA) · Marketing
- AI Product Counsel4d agoSan Francisco, CA · General & Administrative