Research Scientist, AI Controls and Monitoring
$216k - $270k • Remote • San Francisco, CA; New York, NY
Posted 8d ago
Job Location
San Francisco, CA; New York, NY
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Research Engineer
About the job
Scale Labs is launching a new team focused on policy research to bridge the gap between AI research and global policymakers, enabling informed, scientific decisions about AI risks and capabilities. This team tackles complex problems in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. The Research Scientist, AI Controls and Monitoring will design methods, systems, and experiments to ensure advanced AI models and agents remain aligned with intended goals, even in high-stakes or adversarial environments.
Responsibilities
- Develop monitoring techniques and observability methods to track AI behavior in real time and flag deviations, emergent capabilities, or anomalous outputs.
- Research mechanisms for layered control, including fail-safes, oversight protocols, and intervention methods to halt or redirect AI systems when risks are detected.
- Design red-team simulations to probe weaknesses in oversight and control mechanisms and build mitigations.
- Collaborate with policymakers, engineers, and researchers to establish standards and benchmarks for AI monitoring and escalation.
Requirements
- Commitment to promoting safe, secure, and trustworthy AI deployments.
- Practical experience conducting technical research collaboratively, including designing control and monitoring experiments for AI systems.
- Ability to build prototype systems and quickly turn new research ideas into working prototypes.
- A track record of published research in machine learning, particularly in generative AI.
- At least three years of experience addressing sophisticated ML problems in a research or product development setting.
- Strong written and verbal communication skills for cross-functional team collaboration.
Benefits
- Base salary
- Equity
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend