Member of Technical Staff, Post-Training
Remote • London • FullTime
Posted 1y ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Cohere is seeking a Member of Technical Staff to focus on post-training of AI models. This role is crucial for advancing the state of the art in model post-training and shipping cutting-edge models to production, bridging the gap between research and practical application. You will have access to significant compute resources and a talented team to contribute to increasing model capabilities and driving customer value. The position offers a unique opportunity to contribute to both production code and research efforts, depending on your interests and organizational needs.
Responsibilities
- Design and implement high-performance, scalable software for model training.
- Consistently post-train models to achieve state-of-the-art performance levels.
- Collaborate with specialist teams to ensure comprehensive model performance.
- Develop and apply techniques to enhance training cycle performance in both SFT and RL regimes.
- Research, implement, and experiment with new ideas on supercompute and data infrastructure.
- Learn from and work alongside leading researchers in the field.
Requirements
- Exceptional software engineering skills.
- Proficiency in Python and ML frameworks like JAX, PyTorch, and XLA/MLIR.
- Experience with distributed training infrastructures (Kubernetes, Slurm) and frameworks (Ray).
- Experience with large-scale distributed training strategies.
- Hands-on experience training large models at scale.
- Hands-on experience with the post-training phase of model development, focusing on performance optimization.
- Publication at top-tier AI/ML venues is a plus.
Benefits
- Weekly lunch stipend ($75/£75 or local equivalent).
- Full health and dental benefits, including a mental health budget.
- Retirement savings plan matching (RRSP, 401K, Pension Scheme).
- 100% parental leave top-up for up to 6 months.
- Annual enrichment benefits (arts, culture, fitness, wellness, workspace improvement).
- Education and learning stipend for conferences, courses, and coaching.
- 6 weeks (30 working days) of paid vacation.
- Budget for travel to other offices for remote employees.
- Annual company offsite.
- Co-working space benefit for remote employees not near an office.
- $500 home office stipend.