Member of Technical Staff - Multilingual Data
San Francisco, CA • FullTime
Posted 1mo ago
Job Location
San Francisco, CA
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
LLM Engineer
About the job
Reflection is a research lab dedicated to making intelligence open and accessible. We build open models that empower individuals to control their AI and shape its future. This role focuses on designing and operating large-scale multilingual data pipelines, ensuring the quality and effectiveness of data used for training advanced language models. You will contribute to scientific experiments aimed at improving multilingual data efficiency in large language models and develop evaluation sets to identify and address model performance gaps across different languages and domains.
Responsibilities
- Design and operate large-scale multilingual data pipelines, including sourcing, cleaning, deduplication, language identification, and script normalization.
- Define and enforce quality standards for multilingual corpora, covering translation quality, cultural fidelity, toxicity, and contamination.
- Design and execute scientific experiments to enhance multilingual data efficiency in large language models.
- Lead small research projects and collaborate on larger initiatives.
- Build evaluation sets and diagnostics to identify and close model performance gaps by language, register, or domain.
- Collaborate with pre-training, mid-training, and post-training teams to achieve measurable improvements in multilingual capabilities.
Requirements
- Strong software engineering fundamentals and experience processing web-scale datasets in distributed environments.
- Experience building large-scale data pipelines for language models, machine translation, speech, or search, ideally across multiple languages.
- Fluency or working proficiency in at least one language other than English.
- A rigorous, measurement-first mindset to validate data changes.
- Ability to navigate trade-offs between research objectives and engineering realities.
- Comfort with ambiguity and high ownership in a fast-moving team.
Benefits
- Top-tier compensation: Salary and equity structured to recognize and retain talent globally.
- Stock options.
- Comprehensive medical, dental, vision, and life insurance.
- Annual wellness allowance.
- Provided lunch and dinner in the office daily.
- 22 weeks paid parental leave for all new parents.
- Unlimited paid time off in the U.S.
- 30 days paid time off in the U.K.
- Visa sponsorship support.
- Regular off-sites, happy hours, and team celebrations.