Member of Technical Staff - Post-training (Data Infrastructure)
CA$295k - CA$535k • Remote • United States • FullTime
Posted 7h ago
About the job
Cohere is seeking a Member of Technical Staff to join their Post-Training Data Infrastructure team. This role is crucial for building and managing the data pipelines that generate post-training data for large language models (LLMs), including SFT and RL data, as well as synthetic and human-annotated data. You will collaborate closely with researchers and annotation teams to ensure rapid iteration on data, mirroring the pace of model development. The position requires a strong software engineering background and experience in large-scale data pipelines for machine learning, particularly within LLM post-training.
Responsibilities
- Build and maintain data pipelines for SFT, preference, and RL post-training data.
- Ensure dataset quality, versioning, and reproducibility.
- Transform research data recipes into production-grade, reusable components.
- Scale model inference for data generation and model-based grading.
- Design data formats and schemas for consistent and efficient post-training datasets.
- Collaborate with researchers and engineers to align data pipeline development with the needs of cutting-edge language models.
Requirements
- Strong software engineering skills.
- Experience designing and building large-scale data pipelines for machine learning, ideally for LLM post-training.
- Proven track record of running distributed data processing and model inference at scale.
- Good understanding of post-training methods (e.g., SFT, RLHF, DPO) and their impact on model behavior.
- Excellent communication skills.
Benefits
- Weekly lunch stipend of $75/£75 or equivalent.
- Full health and dental benefits, including a mental health budget.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months.
- Annual enrichment benefits (Arts & culture, fitness/wellness, quality time, workspace improvement).
- Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days).
- Budget for traveling to other offices (for remote employees).
- Annual company offsite.
- Co-working benefit for those not near an office.
- $500 home office stipend.