Security Engineer / Research Engineer, RL Security
$320k - $405k • San Francisco, CA | New York City, NY | Seattle, WA
Posted 5h ago
Job Location
San Francisco, CA | New York City, NY | Seattle, WA
Tech Stack
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
Reinforcement learning is crucial for training AI models like Claude to reason, write code, and act autonomously. At scale, RL training involves complex distributed systems running across numerous accelerators and hosts. As an engineer in RL Engineering, you will be responsible for securing this expanding system. This is a hands-on role where you will work directly within the RL codebase and its underlying infrastructure, collaborating with the engineers and researchers who develop and utilize it. The system's rapid evolution, driven by research advancements, requires security solutions that maintain pace without compromising performance or development velocity. We are seeking candidates with expertise in either security engineering for large-scale ML systems or ML systems/research engineering with a strong interest in security.
Responsibilities
- Design, build, and operate security controls for RL training systems and their infrastructure.
- Address security needs across the entire stack, including orchestration, environments, training, and inference.
- Review RL stack designs and code to identify and resolve security vulnerabilities.
- Develop shared libraries and tools to support RL engineers and researchers.
- Build observability tools to monitor system behavior.
- Collaborate with researchers and performance engineers to ensure security measures do not negatively impact training correctness or performance.
- Produce clear design documents for all developed solutions.
Requirements
- Strong software engineering skills in Python and at least one systems language (e.g., Rust, C++, Go).
- Experience designing, building, and operating large-scale distributed systems or production security systems.
- Solid understanding of security fundamentals.
- Working knowledge of Linux, containers, and cloud infrastructure.
- Experience debugging complex issues across multiple hosts and services.
- Ability to balance security, performance, and reliability trade-offs.
- Proficiency in written communication, including creating design documents.
Benefits
- Annual compensation range: $320,000 - $405,000 USD
- Visa sponsorship available
- Encouragement to apply even if not all qualifications are met
- Hybrid work policy (minimum 25% in office)