Operations Analyst, Safety
San Francisco, CA$190k - $300kfull-timePosted 2mo ago
About the role
Role focused on making products safe by default while enabling fast product iteration. Collaborates with product, security, research, and design to bake safety and integrity into human-AI collaboration tools; primarily works in the moderation queue while building tooling and policy to improve moderation speed and accuracy.
Responsibilities
- Review flagged content, safety escalations, and account-level abuse signals daily; triage cases, apply policy judgment, and take action (content flags, account review, bans/recovery).
- Use patterns from casework to design and refine safety policy across the product stack with engineering, legal, safety research, and security stakeholders.
- Build and maintain tooling and automation to speed up casework (triage agents, ban/recovery workflows, abuse detection frameworks and templates).
- Partner with product teams to embed safety into the product experience (model refusals, content flagging, account review, safety protections).
- Improve observability and detection for safety-relevant events (model safety trends, abuse patterns, malicious behavior in production).
Qualifications
- 2+ years in operational trust & safety, content moderation, or fraud/abuse ops with direct, recurring responsibility for a case queue.
- Experience owning policy definition, operationalization, and enforcement end to end with specific policies or enforcement programs.
- Direct case experience with at least one of: cybersecurity abuse, CBRN-relevant risk, youth safety, or prompt injection in a production environment.
- Working familiarity with model safety and abuse risk categories (jailbreaks, prompt injection, scaled abuse) and how to identify and mitigate them in a live product.
- Practical experience using AI tools (Claude, Codex, or similar) to build or accelerate operational workflows.
Skills
Required:Content reviewing and triagePolicy development and enforcementSafety tooling and automationCross-functional collaborationAI safety and abuse risk knowledge
Benefits
- generous health, dental, and vision benefits
- unlimited PTO
- paid parental leave
- relocation support as needed
Last updated Jul 29, 2026. Interested? Apply on the company site.
About Thinking Machines Lab
Connectionism: Research Blog by Thinking Machines Lab
Thinking Machines Lab is an artificial intelligence research and product company. We’re building a future where everyone has access to the knowledge and tools to make AI work for their unique needs and goals.
AIartificial intelligencebessemer-ai-infrastructure-2026deep learningliquid-ai-recruiting-targetmachine learningproductreinforcement-learning-platforms
More open roles at Thinking Machines Lab
- IT Engineer2mo agoNew York, NY · Technical
- Endpoint Engineer, IT2mo agoHybrid (San Francisco, CA and New York, NY) · Technical
- Software Engineer, Full Stack, Tinker3mo agoSan Francisco, CA · Core Engineering, Product, and Infrastructure
- Recruiting Coordinator, Research3mo agoHybrid (San Francisco, CA) · Operations
- Reliability Engineer, Supercomputing3mo agoHybrid (San Francisco, CA) · Core Engineering, Product, and Infrastructure