Member of Technical Staff, RL Research & Environments
$275k - $550k • Remote • San Francisco • FullTime
Posted 1y ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Research Engineer
About the job
As a Research Engineer on the RL Research & Environments team, you will design and operate the data, evaluation, and environment systems that improve model capabilities after pre-training. This role focuses on post-training: identifying capability gaps, building targeted datasets, designing reward signals, and running iterative training loops that measurably improve user-facing behavior. You will own the infrastructure and experimental workflows that connect product priorities to concrete capability gains. Magic’s long-context models introduce distinct post-training challenges, and you will build systems that expose failure modes, generate high-signal training data, and enable rapid RL iteration at scale. This role can evolve into ownership of major capability areas, deeper RL systems work, or broader influence over post-training strategy.
Responsibilities
- Design and build post-training datasets using synthetic generation, targeted data collection, and self-play
- Implement filtering, scoring, and mixture strategies for RL and post-training corpora
- Build and maintain evaluation frameworks that surface long-context failure modes
- Design reward signals and training environments for targeted capability improvements
- Run ablations across data sources, reward designs, and long-horizon task structures
- Improve reliability and observability of post-training data and environment pipelines
- Collaborate closely with Product and Research to translate capability goals into measurable iteration cycles
Requirements
- Strong software engineering fundamentals
- Experience building or operating large-scale data or ML systems
- Ability to design and interpret experiments that measure model behavior changes
- Comfort working at the intersection of ML, data systems, and infrastructure
- Strong attention to data quality and evaluation rigor
- Track record of owning experimental or production systems end-to-end
Benefits
- Equity is a significant part of total compensation, in addition to salary
- 401(k) plan with 6% salary matching
- Generous health, dental and vision insurance for you and your dependents
- Unlimited paid time off
- Visa sponsorship and relocation stipend to bring you to SF, if possible