AI Infrastructure Systems Engineer
$190k - $270k • Remote • San Francisco
Posted 1mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
At Together AI, you will build and operate one of the world's largest GPU fleets for frontier model training and inference. This role is for engineers who excel at building systems, automating processes, and solving problems at a massive scale. If you prefer writing software over manual operations and aim to build infrastructure that autonomously manages tens of thousands of GPUs, we encourage you to apply.
Responsibilities
- Design and build fleet automation systems for provisioning, validating, deploying, upgrading, repairing, and retiring GPU clusters with minimal human intervention.
- Develop AI Infrastructure Agents to automate deployment, root-cause analysis of failures, incident triage, and autonomous remediation.
- Create Fleet Intelligence platforms for continuous monitoring of hardware health, firmware, networking, storage, and thermals to predict failures.
- Build software to maximize GPU availability, utilization, performance, and reliability across thousands of accelerators.
- Develop automated validation systems for GPUs, InfiniBand/RoCE fabrics, NVLink/NVSwitch, storage, and distributed AI workloads.
- Construct internal platforms and developer tools for managing infrastructure through software.
- Continuously enhance deployment velocity, reliability, and operational efficiency via automation.
- Collaborate with hardware, networking, platform, and AI teams to advance AI infrastructure capabilities.
Requirements
- 3+ years of experience building distributed systems, infrastructure platforms, or large-scale backend software.
- Proficiency in software engineering with Python, Go, or Rust.
- Experience building platforms, automation systems, or developer infrastructure.
- Familiarity with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies.
- Strong systems thinking with the ability to understand complex hardware and software interactions.
- A passion for solving intricate infrastructure challenges through software development.
- An automation-first mindset, with a drive to build systems for repetitive tasks.
Benefits
- Competitive compensation
- Startup equity
- Health insurance
- Other competitive benefits