Research Scientist, Safety Post Training
$216k - $270k • Remote • San Francisco, CA; New York, NY
Posted 7d ago
Job Location
San Francisco, CA; New York, NY
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Research Engineer
About the job
Scale Labs is seeking a Research Scientist focused on Safety Post-Training to develop and apply methods for making frontier AI systems safer and more understandable. This role involves designing and executing post-training pipelines to analyze how training choices impact model safety, robustness, and alignment. You will also develop evaluations informed by interpretability techniques to uncover the reasons behind undesirable model behaviors and use these insights to guide targeted safety mitigations. A key aspect of this position is collaborating with policymakers, engineers, and other researchers to translate findings into actionable safety standards, benchmarks, and best practices.
Responsibilities
- Design and run post-training pipelines to study model safety, robustness, and alignment properties.
- Develop interpretability-informed evaluations to reveal why models produce unsafe or undesirable behaviors.
- Use insights from evaluations to guide targeted safety mitigations.
- Collaborate with policymakers, engineers, and researchers to translate findings into safety standards and best practices.
Requirements
- Commitment to promoting safe, secure, and trustworthy AI deployments.
- Experience with post-training and RL techniques such as RLHF, DPO, GRPO.
- Track record of published research in machine learning, particularly in generative AI.
- At least three years of experience addressing sophisticated ML problems.
- Strong written and verbal communication skills for cross-functional collaboration.
- Experience with mechanistic interpretability, probing, or other model understanding techniques (nice to have).
- Familiarity with red-teaming or adversarial evaluation of post-trained models (nice to have).
- Experience studying failure modes introduced or masked by post-training (nice to have).
Benefits
- Base salary
- Equity
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend (potential)