Member of Technical Staff, Training Infra Engineer
CA$250k - CA$535k • Remote • Paris • FullTime
Posted 1y ago
Job Location
Paris
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Cohere is a leading enterprise AI company building cutting-edge foundation AI models and end-to-end products. We are seeking an engineer to provide strong support for model training pipelines, ship state-of-the-art models to production, and bridge the gap between research and production. This role offers access to significant compute resources, data, and talent, with a collaborative environment where engineers contribute to both production code and research efforts based on interest and organizational needs. We are a global company with a remote-friendly approach, valuing exceptional talent regardless of location.
Responsibilities
- Design and write high-performance, scalable software for model training.
- Improve training infrastructure and codebase performance.
- Develop and implement tools to accelerate training cycles and enhance training infrastructure efficacy.
- Research, implement, and experiment with ideas for supercompute and data infrastructure.
- Collaborate with leading researchers in the field.
Requirements
- Exceptional software engineering skills.
- Proficiency in Python and ML frameworks like JAX, PyTorch, and XLA/MLIR.
- Experience with distributed training infrastructures (Kubernetes, Slurm) and frameworks (Ray).
- Experience with large-scale distributed training strategies.
- Hands-on experience training large models at scale and contributing to tooling or setup.
- Bonus: Publication at top-tier AI/ML venues.
Benefits
- Weekly lunch stipend ($75/£75 or local equivalent).
- Full health and dental benefits, including mental health budget.
- Retirement savings plan matching (RRSP, 401K, Pension Scheme).
- 100% parental leave top-up for up to 6 months.
- Annual enrichment benefits (arts, culture, fitness, wellness, quality time, workspace improvement).
- Education and learning stipend for conferences, courses, and coaching.
- 6 weeks (30 working days) of paid vacation.
- Budget for travel to other offices (for remote employees).
- Annual company offsite.
- $500 home office stipend.