Red-teaming Jobs

Anthropic

Anthropic is seeking individuals for a paid, fixed-term research residency program, lasting between six weeks and six months. This program is designed for experienced professionals, such as professors in quantitative disciplines, technical founders, or staff-level engineers, who are looking to transition into full-time work focused on ensuring AI systems are safe and beneficial for humanity. While a background in machine learning is not strictly required, candidates should be motivated by AI safety and excited about empirical AI research. The residency offers a scoped project with direct mentorship from Anthropic researchers, access to Claude models and GPU compute, and connections to the AI safety and security research community.

$350k - $500k

Scale AI

Scale Labs is launching a new team focused on policy research to bridge the gap between AI research and global policymakers, enabling informed, scientific decisions about AI risks and capabilities. This team tackles fundamental challenges in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. The role involves collaborating broadly across industry, the public sector, and academia, and regularly publishing findings to shape the future of AI safety and alignment.

$216k - $270k

Anthropic

Anthropic's Safeguards team is looking for a Red Team Engineer to ensure the safety of their AI systems and products. This role involves taking an adversarial approach to find vulnerabilities before malicious actors can exploit them. The work covers technical infrastructure weaknesses and emergent risks from advanced AI capabilities, focusing on broader safety implications and novel abuses unique to AI systems. You will simulate sophisticated threat actors, investigate potential abuse like account manipulation and payment fraud, and chain multiple attack vectors to achieve objectives.

$320k - $405k

We are an applied AI lab building end-to-end software agents, known for creating Devin, the first AI software engineer. Our team comprises world-class talent from leading AI companies. We are seeking a founding member for our safety team to tackle critical challenges in AI safety and alignment. This role is hands-on, focusing on ensuring our AI agents behave correctly and safely in real-world applications, rather than solely in research benchmarks. You will play a pivotal role in shaping the safety and alignment of our AI systems.

Abundant is an applied research lab focused on scaling reinforcement learning for safe and reliable agentic capabilities. As a Member of Technical Staff, Alignment, you will be instrumental in ensuring that alignment is a core component of all our work, from the code we deploy and the runbooks we write to the papers we publish. This role involves testing models in advanced environments, identifying and mitigating potential risks like reward hacking and deception, and building robust tools to monitor and secure AI agents.

$250k - $450k

OpenAI

This role focuses on oversight and system-level mitigations to enable increasingly capable AI agents to operate safely and autonomously in real environments. The team prioritizes building oversight systems used in practice today, both internally and externally, and studies longer-term questions about how agent systems can be supervised, constrained, and corrected. We are looking for a safety-minded researcher or engineer who can reason rigorously about security boundaries and agent behavior, then build and test practical mitigations. A background in AI control or security is welcome but not required.

$380k - $500k