Senior Member of Technical Staff, Synthetic Data
Remote • Toronto • FullTime
Posted 8mo ago
About the job
Cohere is seeking a Senior Machine Learning Engineer specializing in synthetic data to develop and manage the synthetic data pipeline crucial for advanced language models. This role involves end-to-end management of synthetic data, including pipeline optimization, data analysis and generation, and conducting data ablations and model evaluations. You will transform diverse web and code data using generative models to enhance token efficiency and model quality, bridging research and engineering to improve throughput and accelerator utilization. This position is key to Cohere's mission of delivering efficient and reliable language capabilities and driving innovation in natural language processing.
Responsibilities
- Design and build scalable inference pipelines for large GPU clusters.
- Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance.
- Research and implement innovative synthetic data curation methods leveraging Cohere's infrastructure.
- Collaborate with cross-functional teams to ensure data pipelines meet the demands of cutting-edge language models.
Requirements
- Strong software engineering skills with proficiency in Python and experience building data pipelines.
- Familiarity with data processing frameworks like Apache Spark, Apache Beam, or Pandas.
- Experience working with LLMs through projects, contributions, or experimentation.
- Familiarity with LLM inference frameworks such as vLLM and TensorRT.
- Experience working with large-scale datasets, including web data, code data, and multilingual corpora.
- Passion for bridging research and engineering to solve complex data-related challenges in AI model training.
Benefits
- Weekly lunch stipend of $75/£75 or equivalent.
- Full health and dental benefits with a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months.
- Annual enrichment benefits (Arts & culture, fitness/wellness, quality time, workspace improvement).
- Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days).
- Budget for traveling to other offices if remote.
- Annual company offsite.
- $500 home office stipend.