AI Safety Policy Evaluator, Violence & Threats | Seattle Onsite
Seattle, WA$55/hr - $120/hrFull-timePosted 1mo ago
About the role
Non-engineering content-policy evaluation role focused on violence and threats. Evaluators assess whether model responses appropriately handle violent content, distinguish fiction from real-world harm, and provide concise rationales to train AI models.
Responsibilities
- Evaluate user requests and AI model responses involving violence, weapons, threats, and dark fiction within the full conversation context; maintain accuracy and consistency across repeated evaluations
- Distinguish fictional, educational, historical, and defensive violence from requests that seek real-world uplift or express real intent to harm
- Assess whether a model's response gives meaningful real-world capability, regardless of how the request was framed
- Distinguish expressions of anger, frustration, or dark humor from credible threats or crisis indicators
- Select the most defensible classification when a case is genuinely ambiguous, and write concise rationales that cite policy language and conversation details while applying customer policy consistently
- Write and refine adversarial or borderline prompts that probe where a model draws the line
- Identify policy gaps, contradictions, and emerging edge cases, and raise them with project leads and policy teams
- Participate actively in calibration discussions; challenge interpretations respectfully and update your judgment when stronger reasoning emerges
Qualifications
- You have spent serious time in violent fiction as a writer, game designer, screenwriter, or editor, and you know what good dark fiction looks like and what a story-shaped extraction attempt looks like
- You have real-world exposure to violence and its consequences through military, law enforcement, security, EMS, emergency medicine, or similar work
- You have worked with people in distress through crisis lines, counseling, threat assessment, domestic violence advocacy, school safety, or trust and safety
- You use AI tools heavily and have opinions about where they refuse too much, help too much, or miss the point
- You notice when one word, contextual detail, or change in intent materially affects the answer
- You can hold a strong opinion without becoming attached to being right
- You explain judgment calls clearly and precisely in writing so another person can audit your reasoning
- You can separate your personal views from the standard a customer has asked you to apply and remain careful and consistent during repetitive work with difficult material
Skills
Required:Policy evaluation and classificationClear written reasoning
Benefits
- Benefits are provided through TCWGlobal. Eligible employees can enroll in medical coverage, dental and vision insurance, FSA options, 401(k) with employer match, voluntary insurance options, wellness and other reimbursements, and employee discounts.
- Paid time off accrues from day one at one hour per 40 hours worked with caps and legislative compliance
- Paid holidays include 13 observed holidays with holiday pay per policy
- TCWGlobal Benefits Guide available for details
Last updated Oct 22, 2026. Interested? Apply on the company site.
About Handshake
Careers start here
The better career platform for Gen Z changing how, where, and why the next generation of talent builds their career.
educationcareer platformtalent acquisitionstudent engagement
More open roles at Handshake
- Privacy Associate4d agoSan Francisco, CA · General & Administrative
- Seattle Site Lead4d agoSeattle, WA · HAI Delivery Ops
- Senior Recruiter4d agoSan Francisco, CA · General & Administrative
- Director, Product Marketing4d agoHybrid (San Francisco, CA) · Marketing
- AI Product Counsel4d agoSan Francisco, CA · General & Administrative