Member of Technical Staff - Pre-Training
San Francisco, CA • FullTime
Posted 9mo ago
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Reflection is a research lab dedicated to making intelligence open and accessible for everyone. We build open models that empower individuals to control their intelligence and shape the future of AI. As a Member of Technical Staff - Pre-Training, you will be instrumental in researching and building solutions across algorithms, scaling laws, data processing, optimizers, and model architecture. This role involves designing and executing scientific experiments to deepen our understanding of scaling large language models and data efficiency, while also implementing state-of-the-art deep learning methods. You will have the opportunity to lead small research projects independently and contribute to larger initiatives, optimizing training infrastructure for efficient scaling and working across the entire stack from low-level optimizations to high-level model design.
Responsibilities
- Research and build solutions across algorithms, scaling laws, data processing, optimizers, and model architecture.
- Design and run scientific experiments to advance understanding of scaling large language models and data efficiency.
- Implement state-of-the-art methods from the deep learning literature.
- Lead small research projects independently while collaborating on larger initiatives.
- Optimize the training infrastructure for efficient scaling.
- Contribute across the entire stack, from low-level optimizations to high-level model design.
Requirements
- Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline.
- Solid software engineering capabilities with experience building large-scale systems.
- Experience with large-scale ETL workflows and training data preparation.
- Deep understanding of large-scale ML, especially as it relates to language models, distributed training, and scaling.
- Proficient in Python and deep learning frameworks (PyTorch preferred).
- Ability to navigate trade-offs between research objectives and practical engineering realities.
- Thrive in a fast-paced, high-agency startup environment with bias toward action.
- Strong communication capabilities and comfort working collaboratively.
- Passionate about advancing the frontier of intelligence.
Benefits
- Top-tier compensation: Salary and equity structured to recognize and retain talent globally.
- Stock options.
- Comprehensive medical, dental, vision, and life insurance.
- Annual wellness allowance.
- Lunch and dinner provided in the office daily.
- 22 weeks paid parental leave for all new parents.
- Unlimited paid time off in the U.S.
- 30 days paid time off in the U.K.
- Sponsorship support for visas and long-term immigration pathways.
- Regular off-sites, happy hours, and team celebrations.