Platform Engineer, Model Shaping
$200k - $290k • Remote • San Francisco
Posted 24d ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Categories
Machine Learning Engineer
About the job
The Model Shaping team at Together AI focuses on products and research for tailoring open foundation models to downstream applications. We build services that enable machine learning developers to select optimal models for their tasks and enhance them with domain-specific data. Additionally, we develop novel methods for efficient model training and evaluation, drawing from diverse ideas in machine learning, natural language processing, and ML systems. As a Platform Engineer in this team, you will operate at the intersection of backend engineering and infrastructure, developing the core layers of Together’s platform for model customization and evaluation. Your role will involve designing, developing, and maintaining the backend services and underlying systems necessary for sustainably and reliably scaling production workflows for users and internal research experiments. You will collaborate cross-functionally with other engineers and researchers to enhance infrastructure based on project needs and integrate services with other engineering teams at Together.
Responsibilities
- Design and build systems and infrastructure for model customization, including user-facing features and internal improvements.
- Contribute to platform reliability by participating in on-call rotations and improving incident response processes.
- Create and enhance internal tooling for deployment, continuous integration, and observability.
- Build a job orchestration platform across multiple datacenters, supporting diverse hardware.
- Partner with teams developing internal services, co-designing and integrating them into Together's systems.
Requirements
- 3+ years of experience building infrastructure or backend components for production services.
- Extensive experience designing, operating, and troubleshooting production Linux environments and Kubernetes-based platforms.
- Strong software engineering background in Python or Go.
- Experience with infrastructure automation tools (Terraform, Ansible), monitoring/observability stacks (Prometheus, Grafana), and CI/CD pipelines (GitHub Actions, ArgoCD).
- Cloud environment (AWS/GCP/Azure) administration experience, preferably with hybrid bare-metal/cloud environments.
- Strong communication skills, with a willingness to document systems and processes and collaborate with peers of varying technical expertise.
- Comfortable operating across the full stack, from cluster operations and infrastructure automation to backend service development.
Benefits
- Competitive compensation
- Startup equity
- Health insurance
- Flexibility in terms of remote work