Research Engineer, Safety
$200k - $400k • San Francisco • FullTime
Posted 1mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Engineer
About the job
Decagon is seeking a Research Engineer focused on Safety to ensure the reliability and controllability of their AI agents. This role involves identifying real-world failure modes and developing the necessary models, evaluations, and safeguards to prevent them. The ideal candidate will be a strong engineer passionate about advancing applied AI safety in production, with the ability to own projects end-to-end and make high-impact technical decisions.
Responsibilities
- Research and build safeguards against prompt injection, unsafe tool use, sensitive data disclosure, policy violations, and hallucinated commitments.
- Develop adversarial evaluations, simulations, red-team datasets, and regression suites informed by production failures.
- Develop and deploy classifiers, judges, reward signals, post-training methods, and runtime safeguards for safer agent behavior.
- Analyze production traces and incidents to identify root causes, test mitigations, and measure their impact.
- Collaborate with Security, Product, Infrastructure, Legal, and customer-facing teams to implement scalable safeguards and rollout practices.
Requirements
- 2+ years of experience in AI/ML engineering, research, or AI safety.
- Hands-on experience evaluating, post-training, or deploying language models or agentic systems.
- Experience with modern post-training techniques (e.g., reinforcement learning, preference optimization, distillation, model routing, synthetic-data generation).
- Experience with adversarial testing, model red teaming, prompt injection, policy enforcement, privacy, or safe tool use.
- Fluency in Python and modern ML tooling.
- Strong experimental judgment and engineering depth to ship production systems.
- Comfort owning ambiguous, high-stakes technical problems and making clear risk and product tradeoffs.
Benefits
- Equity
- Medical, Dental, and Vision benefits
- Life Insurance and Disability Benefits
- Retirement Plan
- Parental Leave
- Fertility and family building benefits
- Monthly stipend for wellness, lifestyle, and work-life balance
- Daily lunches and snacks in the office
- Take what you need vacation policy
