TPU Jobs

We are seeking a Software Engineer, Inference to be responsible for the reliability, scale, and efficiency of the systems that serve our AI models to users. This production-facing systems role is central to the company, acting as a bridge between cutting-edge inference techniques and the practicalities of serving live traffic, including rollouts, capacity management, and incident response. You will ensure that performance gains from our research and inference teams reach production safely and remain operational, powering our live serving platform and related products.

$300k - $400k

Physical Intelligence is developing foundation models and learning algorithms to power future physically-actuated devices. In this role, you will be instrumental in scaling and optimizing our training systems and core model code. You will take ownership of critical infrastructure for large-scale training, encompassing GPU/TPU compute management, job orchestration, and the creation of efficient, reusable JAX training pipelines. This position offers a hands-on, high-leverage opportunity at the intersection of machine learning, software engineering, and scalable infrastructure, working closely with researchers and model engineers to translate innovative ideas into production-ready training runs.

Thinking Machines is seeking a Site Reliability Engineer (SRE) to ensure the speed, reliability, and ease of iteration for our post-training and reinforcement learning (RL) systems. This role is akin to production engineering or site reliability, focused on model training infrastructure. You will be responsible for the health of training runs, clusters, and pipelines, working closely with research teams to debug issues in real-time, strengthen infrastructure, and develop tools and automation that allow researchers to focus on scientific discovery rather than job management. This position offers significant ownership, requiring you to be the point person for critical issues during active model runs and to implement solutions preventing future occurrences.

$300k - $350k

Anthropic

Anthropic's Inference organization is responsible for delivering Claude to millions of users and enterprise customers with the speed, reliability, and efficiency that frontier AI demands. We are seeking a Staff engineer to lead the Inference Developer Productivity team. This team is dedicated to making every engineer in the organization significantly more effective at building, testing, and shipping inference software. This senior individual contributor role involves broad technical ownership, where you will set the technical direction for the team's toolchains, workflows, and feedback loops. You will be responsible for making critical decisions on architecture, prioritization, and trade-offs across heterogeneous accelerator platforms. You will partner closely with the Engineering Manager, who handles hiring and people development, while you drive the technical roadmap and execution. Collaboration with Anthropic's central Infrastructure organization is also key to ensure Inference's multi-accelerator reality is well-supported without duplicating efforts.

$405k - $485k

Etched is building hardware for frontier intelligence, focusing on inference. We are seeking talented interns to contribute to the design of next-generation AI accelerators. This role involves developing and optimizing compute architectures for exceptional performance and efficiency in inference workloads, tackling cutting-edge architectural problems and performance modeling.

Etched is building hardware for frontier intelligence, focusing on inference. We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and latency. Backed by significant investment and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest-growing industry. We are a fully in-person team in San Jose, valuing engineering skills and expecting technical staff to contribute across disciplines, blurring the lines between engineering and research.

$175k - $400k