AI Infrastructure Engineer

$190k - $270k Remote San Francisco

Posted 1mo ago

Job Location

San Francisco

Tech Stack

Remote Work Policy

Fully remote

Categories

AI Infrastructure Engineer

About the job

As an AI Infrastructure Engineer at Together, you will be responsible for ensuring the smooth operation of all user-facing services and production systems. This role blends pragmatic operations with software engineering, applying sound engineering principles, operational discipline, and mature automation to our operating environments and codebase. You will specialize in systems (operating systems, storage subsystems, networking), implementing best practices for availability, reliability, and scalability, with varied interests in algorithms and distributed systems. Together AI is a research-driven artificial intelligence company focused on lowering the cost of modern AI systems through co-designing software, hardware, algorithms, and models, and we invite you to join our passionate group of researchers and engineers in building the next generation of AI infrastructure.

Responsibilities

  • Participate in on-call rotation to respond to production incidents
  • Build and run infrastructure using Ansible, Terraform, and Kubernetes for massive user scaling
  • Build monitoring systems to ensure high-quality service
  • Design and implement operational processes like deployments and upgrades
  • Debug production issues across all services and stack levels
  • Identify product architecture improvements for reliability, performance, and availability
  • Plan the growth of the company's infrastructure

Requirements

  • 5+ years of professional AI Infra or related experience
  • Bachelor's degree in Computer Science or related field, or equivalent work experience
  • Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
  • Proficiency in programming/scripting languages
  • Direct experience in monitoring and observability practices
  • Knowledge of cloud services
  • Ability to thrive in a collaborative environment with diverse stakeholders

Benefits

  • Competitive compensation
  • Startup equity
  • Health insurance
  • Other competitive benefits

About Together AI

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.