Safeguards Enforcement Analyst, Account Takeover & Credential Abuse
Remote • Remote-Friendly, United States; San Francisco, CA | New York City, NY | Washington, DC
Posted 16d ago
About the job
As a Safeguards Enforcement Analyst on the account abuse team, you will build and execute enforcement workflows to ensure product safety, with a primary focus on detecting and mitigating account compromise. This role involves distinguishing between compromised customer accounts and malicious actors, addressing the growing threat of stolen credentials and leaked keys. You will own the end-to-end process, including detection, revocation, user notification, remediation, and access restoration criteria, transforming incident response into a scalable program. The position may expand to cover broader enforcement areas, contributing to Anthropic's mission of developing safe and beneficial AI systems.
Responsibilities
- Investigate credential-compromise incidents across platforms, tracing actor behavior.
- Design and operate remediation workflows for compromised accounts, including revocation and customer notification.
- Partner with Engineering and Data Science to differentiate compromised customer traffic from abuse.
- Enforce usage policies to detect and mitigate harmful AI system use.
- Collaborate with threat intelligence on emerging credential-abuse patterns.
- Provide feedback to the Safeguards policy design team on policy gaps.
- Stay updated on AI policy enforcement best practices.
- Develop policy frameworks for compromise scenarios.
- Serve as the enforcement subject matter expert for account compromise intersecting with abuse investigations.
Requirements
- Experience in trust and safety, fraud investigation, security operations, or a related field.
- Subject matter expertise in account takeover, credential abuse, session security, or incident response.
- Experience designing or operating enforcement, remediation, or customer-recovery flows.
- Proficiency in using data (SQL or similar) to trace actor behavior and measure effectiveness.
- A balanced perspective on platform protection versus restoring access for legitimate users.
- Strong written communication skills for briefs to technical and non-technical stakeholders.
- Excellent judgment and collaboration skills in a fast-paced environment.
- Familiarity with credential-theft ecosystems or threat intelligence tooling.
- Experience with fraud/risk vendors.
- Experience with API platform abuse.
- A deep interest in AI safety and responsible technology development.
- Experience writing effective prompts for generative AI systems in content review or enforcement.
Benefits
- Annual compensation range: $245,000 - $285,000 USD
- Visa sponsorship available for some roles