Safety Operations Lead
$190k - $300k • San Francisco
Posted 1d ago
About the job
Thinking Machines Lab is seeking an Operations Analyst to focus on ensuring product safety while supporting rapid product iteration. This role involves close collaboration with product engineers, security, researchers, and designers to integrate safety and integrity into the entire product lifecycle. Daily tasks will include managing the moderation queue and developing tools and policies to enhance the speed and accuracy of future moderation efforts.
Responsibilities
- Review flagged content, safety escalations, and account-level abuse signals daily, including triaging cases, applying policy judgment, and taking action.
- Design and refine safety policy across the product stack based on casework patterns, collaborating with engineering, legal, safety research, and security.
- Build and maintain tooling and automation to improve casework speed and consistency, such as triage agents, ban/recovery workflows, and abuse detection frameworks.
- Partner with product teams to embed safety into the user experience, including model refusals, content flagging, and account review.
- Improve observability and detection of safety-relevant events to expedite case surfacing and enhance signal quality.
Requirements
- 2+ years in an operational trust & safety, content moderation, or fraud/abuse ops role with direct case queue responsibility.
- Experience owning policy definition, operationalization, and enforcement end-to-end.
- Direct case experience with cybersecurity abuse, CBRN-relevant risk, youth safety, or prompt injection in a production environment.
- Working familiarity with model safety and abuse risk categories (jailbreaks, prompt injection, scaled abuse) and mitigation strategies.
- Practical experience using AI tools (e.g., Claude, Codex) to build or accelerate operational workflows.
Benefits
- Generous health, dental, and vision benefits
- Unlimited PTO
- Paid parental leave
- Relocation support