Research Engineer, Post-Training Inference

$200k - $290k • Remote • San Francisco

Posted 24d ago

Remote Work Policy

Fully remote

Categories

AI Research Engineer

About the job

Together AI's Model Shaping team focuses on tailoring open foundation models for downstream applications, building services that help ML developers select and improve models with domain-specific data. The team also develops efficient model training and evaluation methods, drawing from machine learning, NLP, and ML systems. As a Research Engineer, you will develop a platform for users to customize open-source models with their own data, working across training and inference stacks. You will build and enhance services for Fine-Tuning, Reinforcement Learning, and Evaluation, ensuring a smooth transition from post-training to production serving and optimizing inference engines for RL training. Collaboration with product, research, and engineering teams is key to maintaining API reliability and performance, ultimately contributing to the foundational layer of the open-source AI ecosystem.

Responsibilities

  • Design and build systems for customizing open-source models.
  • Integrate Model Shaping and Inference platforms for seamless post-training to production serving.
  • Add features to inference engines for large-scale post-training experiments, including RL workload optimizations.
  • Ensure service stability and robustness, participating in on-call rotations for 24/7 platform availability.

Requirements

  • 2+ years of experience building and deploying ML-based services in production.
  • Hands-on experience with modern inference engines (e.g., SGLang, vLLM, TensorRT-LLM).
  • Familiarity with the latest methods for fine-tuning LLMs and AI models.
  • Strong software engineering background in Python or Go.
  • Stay updated with the latest advances and trends in the machine learning community.

Benefits

  • Competitive compensation
  • Startup equity
  • Health insurance
  • Other benefits

About Together AI

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.