Researcher, Agent Safety, Training and Evaluations
$380k - $500k • San Francisco • FullTime
Posted 1mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
The Agent Safety team is dedicated to ensuring that advanced AI agents operate safely, make sound judgments, and align with user intentions. The mission is to minimize the risk of severe unintended consequences from increasingly capable AI agents while maintaining their effectiveness and autonomy. This involves creating training methods, environments, and data to teach agents better decision-making, building evaluation systems to identify emerging risks, and developing oversight mechanisms to reduce harmful actions.
Responsibilities
- Train and evaluate frontier models to reduce harmful or misaligned agent actions, forming clear hypotheses and executing independently.
- Mine incidents and build scalable measurement, data-processing, and evaluation systems to convert real failures into repeatable safety signals.
- Collaborate with post-training, capabilities, oversight, and pre-training teams to integrate research-backed mitigations into large-scale training and agent systems.
Requirements
- Demonstrated strength in research engineering, ML engineering, quantitative research, or applied model research, with the ability to own ambiguous projects end-to-end.
- Excellent technical execution across experimentation, data, evaluation, and/or infrastructure.
- Strong intuition for modern frontier-model research.
- Motivation by agent safety and eagerness to work on urgent, practical problems.