Tech Lead Manager- MLRE, ML Systems
$265k - $331k • San Francisco, CA; New York, NY
Posted 2mo ago
Job Location
San Francisco, CA; New York, NY
Tech Stack
Remote Work Policy
On-site
Categories
Machine Learning Engineer
About the job
Scale's LLM post-training platform team builds our internal distributed framework for large language model training, powering MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs. This platform also serves as the underlying training framework for the data quality evaluation pipeline. You will work closely with Scale’s ML teams and researchers to build the foundation platform which supports all our ML research and development works, optimizing it to enable next generation LLM training, inference, and data curation. If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you!
Responsibilities
- Build, profile, and optimize the training and inference framework.
- Collaborate with ML and research teams to accelerate their research and development.
- Enable ML and research teams to develop next-generation models and data curation.
- Research and integrate state-of-the-art technologies to optimize the ML system.
Requirements
- Passion for system optimization.
- Experience with multi-node LLM training and inference.
- Experience developing large-scale distributed ML systems.
- Experience with post-training methods like RLHF/RLVR and related algorithms (e.g., PPO/GRPO).
- Strong software engineering skills.
- Proficiency in frameworks and tools such as CUDA, Pytorch, transformers, flash attention.
- Strong written and verbal communication skills for cross-functional team environments.
- Demonstrated expertise in post-training methods and/or next-generation use cases for large language models (instruction tuning, RLHF, tool use, reasoning, agents, multimodal).
Benefits
- Base salary
- Equity
- Comprehensive health, dental, and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend