Research Scientist, Safety Post Training
$216k - $270k • San Francisco, CA; New York, NY
Posted 2mo ago
Job Location
San Francisco, CA; New York, NY
Tech Stack
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
Scale Labs is seeking talented researchers to join a new team focused on policy research, bridging the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities. This role will develop and apply post-training methods and interpretability techniques to make frontier AI systems safer and better understood. You will design and run post-training pipelines, develop interpretability-informed evaluations, and collaborate with policymakers, engineers, and other researchers to translate findings into actionable safety standards and best practices.
Responsibilities
- Design and run post-training pipelines to study how training choices affect model safety, robustness, and alignment properties.
- Develop interpretability-informed evaluations to reveal how and why models produce undesirable behaviors, and use insights to guide targeted mitigations.
- Collaborate with policymakers, engineers, and other researchers to translate post-training and interpretability findings into actionable safety standards, evaluation benchmarks, and best practices.
Requirements
- Commitment to promoting safe, secure, and trustworthy AI deployments.
- Experience with post-training and RL techniques such as RLHF, DPO, GRPO, and similar approaches.
- A track record of published research in machine learning, particularly in generative AI.
- At least three years of experience addressing sophisticated ML problems in a research or product development setting.
- Strong written and verbal communication skills for cross-functional team collaboration.
Benefits
- Base salary
- Equity
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend