Member of Technical Staff - Safety
San Francisco, CA • Full-time
Posted 5d ago
Remote Work Policy
On-site
Employment Type
Full-time
Visa Sponsorship
The posting says they sponsor visas
Categories
AI Engineer
About the job
Reflection is a research lab dedicated to making intelligence open and accessible for everyone. We build open models that empower users to control their intelligence and shape the future of AI. This role is critical in ensuring the safety and reliability of our models before they are released to the public. You will be responsible for rigorously testing our models to identify and address potential failure modes, working closely with the Alignment team to implement necessary guardrails, and acting as a gatekeeper for all open-weight releases.
Responsibilities
- Own the red-teaming and adversarial evaluation pipeline for Reflection’s models, probing for security, misuse, and alignment gaps.
- Collaborate with the Alignment team to translate safety findings into concrete guardrails for model behavior.
- Validate that all model releases meet the lab’s risk thresholds before shipping.
- Develop scalable, automated safety benchmarks that evolve with model capabilities.
- Research and implement state-of-the-art jailbreaking techniques and defenses.
Requirements
- Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline, or equivalent practical experience in AI Safety.
- Deep technical understanding of LLM safety, including adversarial attacks, red-teaming methodologies, and interpretability.
- Strong software engineering capabilities with experience building automated evaluation pipelines or large-scale ML systems.
- Experience with Reinforcement Learning (RLHF/RLAIF) and its impact on model safety and alignment is a strong plus.
- Ability to thrive in a fast-paced, high-agency startup environment.
- Willingness to make high-stakes decisions regarding model release and safety thresholds.
Benefits
- Top-tier compensation: Salary and equity structured to recognize and retain talent globally.
- Stock options
- Comprehensive medical, dental, vision, and life insurance
- Annual wellness allowance
- Provided lunch and dinner in the office daily
- 22 weeks paid parental leave
- Unlimited paid time off in the U.S.
- 30 days paid time off in the U.K.
- Visa sponsorship support
- Regular off-sites, happy hours, and team celebrations
