Tech Lead Manager- MLRE, ML Systems
$290k - $363k • Remote • San Francisco, CA; New York, NY
Posted 8d ago
Job Location
San Francisco, CA; New York, NY
Tech Stack
Remote Work Policy
Fully remote
Categories
LLM Engineer
About the job
Scale's LLM post-training platform team builds an internal distributed framework for large language model training, powering MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs. This platform also serves as the underlying training framework for the data quality evaluation pipeline. You will work closely with Scale’s ML teams and researchers to build the foundation platform which supports all our ML research and development works, enabling next generation LLM training, inference, and data curation.
Responsibilities
- Build, profile, and optimize the training and inference framework.
- Collaborate with ML and research teams to accelerate their research and development.
- Enable teams to develop the next generation of models and data curation.
- Research and integrate state-of-the-art technologies to optimize the ML system.
Requirements
- Passionate about system optimization.
- Experience with multi-node LLM training and inference.
- Experience developing large-scale distributed ML systems.
- Experience with post-training methods like RLHF/RLVR and related algorithms (PPO/GRPO).
- Strong software engineering skills, proficient in frameworks and tools such as CUDA, PyTorch, transformers, flash attention.
- Strong written and verbal communication skills for cross-functional team collaboration.
Benefits
- Base salary, equity, and benefits.
- Comprehensive health, dental, and vision coverage.
- Retirement benefits.
- Learning and development stipend.
- Generous PTO.
- Potential commuter stipend.