Caching Jobs

Baseten is seeking a Software Engineer to join the Agent Infra team, focusing on building and enhancing Agent Drive, a distributed filesystem critical for agent sandboxes. This role involves developing a storage solution that supports thousands of concurrent sandbox mounts with strict data isolation and consistency. The work leverages advanced storage techniques like tiered caching, replication, and content-addressed data, with a focus on Linux filesystem internals. The team operates with a high degree of ownership, shipping features rapidly and contributing to the core infrastructure that powers leading AI companies.

$160k - $330k

Inworld is a research lab and inference provider focused on real-time AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, real-time workloads. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more, serving over 10 trillion LLM tokens per month. We are looking for strong individuals from varied backgrounds who learn fast, thrive in ambiguity, and can demonstrate their experience in building, breaking, and understanding complex systems.

$250k - $300k

Amplitude is seeking a Staff Software Engineer to join their Query team, focusing on their in-house OLAP engine, Nova. This role is critical for powering AI agents that autonomously ship features and make prioritization calls by ensuring Nova can handle trillions of events in real-time. You will work across the full stack of this modern OLAP system, driving improvements in performance, cost-efficiency, and reliability. This is an opportunity to influence technical direction, mentor other engineers, and make a significant impact on a system that directly serves thousands of customers.

$198k - $299k

Amplitude is seeking a Staff Software Engineer to join their Query team, focusing on their in-house OLAP engine, Nova. This role is critical for powering AI agents that will autonomously ship features, run experiments, and make prioritization calls. You will work across the full stack of a modern OLAP system, including query planning and execution, columnar storage, distributed compute, caching, and cloud infrastructure. The goal is to drive significant improvements in performance, cost-efficiency, and reliability at scale, ensuring Nova can handle the increasing demand from non-stop AI agents. This position offers the opportunity to influence technical direction, mentor other engineers, and make a tangible impact on a system that serves thousands of customers.

$198k - $299k

Anthropic

Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry's largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms.

€295k - €355k