Research Engineer, Post-Training Inference
$200k - $290k • Remote • San Francisco
Posted 24d ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Research Engineer
About the job
Together AI's Model Shaping team focuses on tailoring open foundation models for downstream applications, building services that help ML developers select and improve models with domain-specific data. The team also develops efficient model training and evaluation methods, drawing from machine learning, NLP, and ML systems. As a Research Engineer, you will develop a platform for users to customize open-source models with their own data, working across training and inference stacks. You will build and enhance services for Fine-Tuning, Reinforcement Learning, and Evaluation, ensuring a smooth transition from post-training to production serving and optimizing inference engines for RL training. Collaboration with product, research, and engineering teams is key to maintaining API reliability and performance, ultimately contributing to the foundational layer of the open-source AI ecosystem.
Responsibilities
- Design and build systems for customizing open-source models.
- Integrate Model Shaping and Inference platforms for seamless post-training to production serving.
- Add features to inference engines for large-scale post-training experiments, including RL workload optimizations.
- Ensure service stability and robustness, participating in on-call rotations for 24/7 platform availability.
Requirements
- 2+ years of experience building and deploying ML-based services in production.
- Hands-on experience with modern inference engines (e.g., SGLang, vLLM, TensorRT-LLM).
- Familiarity with the latest methods for fine-tuning LLMs and AI models.
- Strong software engineering background in Python or Go.
- Stay updated with the latest advances and trends in the machine learning community.
Benefits
- Competitive compensation
- Startup equity
- Health insurance
- Other benefits