Research Engineer, Post-Training (All Industry Levels)
$225k - $400k • Remote • Redwood City or New York City • FullTime
Posted 2y ago
Job Location
Redwood City or New York City
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Machine Learning Engineer
About the job
Joining Character.AI as a Research Engineer on the Post-Training team, you will focus on fine-tuning AI models, optimizing their performance, and ensuring high quality and efficiency. Your work will directly contribute to groundbreaking advancements in AI, shaping an era where technology acts as a companion. The Post-Training team develops powerful pretrained language models into intelligent, engaging, and aligned products. You will work across teams and the technical stack to improve model performance and training methods, impacting the conversational experience of millions of users daily.
Responsibilities
- Develop alignment algorithms and loss functions to improve data sample efficiency.
- Write data pipelines to process diverse web data into a format models can ingest.
- Identify quality signals to understand model performance in the real world.
- Design sampling algorithms to improve serving efficiency of large generative models.
Requirements
- PhD (or equivalent) in a relevant field.
- Ability to write clear and clean production-facing and training code.
- Experience working with GPUs for training, serving, and debugging.
- Experience with data pipelines and data infrastructure.
- Strong understanding of modern machine learning techniques, including reinforcement learning and transformers.
- Track record of exceptional research or creative applied ML projects.
Benefits
- Experience with product experimentation and A/B testing (Nice to Have)
- Experience training large models in a distributed setting (Nice to Have)
- Familiarity with ML deployment and orchestration (Kubernetes, Docker, cloud) (Nice to Have)
- Publications in relevant academic journals or conferences in the field of machine learning (Nice to Have)