← All roles

AI Model Policy Trainer, Mental Health (Seattle)

Handshake· HAI Delivery Ops
Apply on company site
Seattle, WA$45k - $65kFull-timePosted 4mo ago

About the role

AI Model Policy Trainer focused on mental health. Responsible for evaluating how conversational AI systems respond to emotional distress and mental-health related scenarios, using a detailed safety policy to assess empathy, grounding, and risk without reinforcing harmful beliefs.

Responsibilities

  • Review user conversations and AI responses involving mental health, emotional distress, crisis, unusual beliefs, paranoia, hallucinations, mania, and related experiences
  • Apply detailed policy taxonomies and evaluation criteria to classify user requests and model behavior; evaluate individual messages and changes across longer conversations
  • Distinguish between validating a person’s emotions and validating an unsupported or potentially harmful explanation; assess whether responses reinforce or escalate harmful beliefs
  • Evaluate actions taken by AI systems through tools, including searches, messages, scheduling, purchases, file creation, and publication
  • Write clear rationales that connect each evaluation decision to evidence from the conversation and policy
  • Participate in calibration exercises and work with other trainers to improve consistency and provide evidence-based peer feedback
  • Identify ambiguous examples, gaps, and edge cases that may require policy clarification
  • Collaborate with researchers, policy specialists, operations teams, and other experts; incorporate coaching as policies and model capabilities evolve

Qualifications

  • Direct experience supporting individuals or families through mental-health or behavioral-health challenges is required (e.g., clinical care, social work, nursing, crisis support, professional caregiving, certified peer support, family advocacy, care navigation)
  • AI or technology experience is helpful but not a substitute for domain experience

Skills

Required:Direct mental-health or behavioral-health experiencePolicy analysis and rationale writing

Benefits

  • Medical coverage, including prescription and mental health benefits, dental and vision insurance
  • Healthcare and dependent care flexible spending accounts, pretax commuter benefits
  • 401(k) retirement plan with employer match
  • Volunteer accident, critical illness, and term life insurance
  • Wellness and pet-related reimbursements, charitable matching, employee discounts
  • Paid time off (PTO) accrues from first day
  • Paid holidays (13 observed)
  • Additional paid sick leave per Washington and Seattle requirements
Last updated Oct 22, 2026. Interested? Apply on the company site.
Handshake logo

About Handshake

Careers start here

The better career platform for Gen Z changing how, where, and why the next generation of talent builds their career.

educationcareer platformtalent acquisitionstudent engagement

More open roles at Handshake