Research Scientist, AI Controls and Monitoring
$216k - $270k • Remote • San Francisco, CA; New York, NY
Posted 2mo ago
Job Location
San Francisco, CA; New York, NY
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Research Engineer
About the job
Scale Labs is seeking a Research Scientist focused on AI Controls and Monitoring to join a new team dedicated to policy research. This role will bridge the gap between AI research and policymakers, focusing on scientific decisions about AI risks and capabilities. The team tackles challenges in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. You will design methods, systems, and experiments to ensure advanced AI models and agents remain aligned with intended goals, even in high-stakes or adversarial environments. This role involves collaboration across industry, the public sector, and academia, with regular publication of findings.
Responsibilities
- Develop monitoring techniques and observability methods to track AI behavior in real time and identify deviations, emergent capabilities, or anomalous outputs.
- Research mechanisms for layered control, including fail-safes, oversight protocols, and intervention methods to halt or redirect AI systems when risks are detected.
- Design red-team simulations to probe weaknesses in oversight and control mechanisms, and build mitigations to close identified gaps.
- Collaborate with policymakers, engineers, and other researchers to establish standards and benchmarks for AI monitoring and escalation.
Requirements
- Commitment to promoting safe, secure, and trustworthy AI deployments.
- Practical experience conducting technical research collaboratively, including designing control and monitoring experiments for AI systems.
- Ability to build prototype systems and quickly translate research ideas into working prototypes.
- A track record of published research in machine learning, particularly in generative AI.
- At least three years of experience addressing sophisticated ML problems in research or product development.
- Strong written and verbal communication skills for cross-functional team collaboration.
Benefits
- Base salary
- Equity
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend