Baseten

Baseten is seeking a Software Engineer to join the Agent Infra team, focusing on building and enhancing Agent Drive, a distributed filesystem critical for agent sandboxes. This role involves developing a storage solution that supports thousands of concurrent sandbox mounts with strict data isolation and consistency. The work leverages advanced storage techniques like tiered caching, replication, and content-addressed data, with a focus on Linux filesystem internals. The team operates with a high degree of ownership, shipping features rapidly and contributing to the core infrastructure that powers leading AI companies.

$160k - $330k

Baseten powers mission-critical inference for leading AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling. We enable companies at the frontier of AI to bring cutting-edge models into production. The Agent Infra team builds a custom networking stack for our sandboxes, designed for the scale of numerous isolated machines that constantly suspend, resume, and exchange data. This role focuses on building a user-space networking stack using VPP, enabling multi-tenant virtual private networking for agents and services.

$160k - $330k

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are building the platform engineers use to ship AI products, recently securing $1.5B in Series F funding. The Agent Infra team is responsible for the core virtualization layer that powers our agent sandboxes. This layer provides each agent with its own isolated microVM, capable of running code, calling tools, and maintaining state across long tasks. We are building a cloud infrastructure from the ground up, focusing on multi-tenancy and deep hardware integration.

$165k - $330k

Baseten is seeking a Backend/Distributed Systems Engineer to join their Product Platform team. This role is central to Baseten's mission of powering mission-critical AI inference for leading AI companies. You will work on key areas such as commercialization, billing, partnerships, developer productivity, agentic development, and the observability platform. The position offers the opportunity to design and build scalable systems, own core platforms, and contribute to the company's growth at the forefront of AI development.

$165k - $330k

Baseten powers mission-critical inference for leading AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling. We enable companies at the frontier of AI to bring cutting-edge models into production. This role focuses on the applied end of post-training research, working directly with stakeholders from fast-growing AI companies to post-train open-source models that outperform frontier closed models on specialized tasks. The day-to-day involves extracting signal from complex, domain-specific datasets and building reward functions, environments, eval harnesses, and training pipelines to improve models that ship to production and reach millions of users.

$200k - $275k

Baseten is seeking an Engineering Manager to lead a portion of their Inference Performance team. This team is responsible for accelerating and optimizing the performance of demanding AI workloads on GPUs. The role involves managing and growing a team of inference performance engineers focused on the inference engine and runtime, including areas like kernels, scheduling, batching, KV-cache management, and speculative decoding. It's a hands-on technical leadership position where you will define the team's direction, solve complex problems, and contribute technically to GPU performance while also focusing on hiring, developing, and supporting your team members. Your team's work will directly impact customer model inference speed and serving efficiency, and you will play a key role in shaping the team's structure as it scales.

$240k - $270k

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are seeking distributed systems engineers and product-minded generalists to build the distributed runtime that powers large-scale LLM inference on Baseten. Our inference platform ensures customers can deploy and operate advanced models with industry-leading performance, scalability, and reliability. You will work across the entire stack, from the developer experience for model deployment to the systems orchestrating Kubernetes and routing traffic efficiently, ensuring every model on our platform is fast, reliable, and cost-efficient.

$180k - $360k

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are seeking inference performance engineers to make demanding AI workloads run faster and more efficiently. You will work across the entire stack, from the inference engine and runtime through scheduling, serving, and routing, applying advanced techniques to optimize performance. This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to LLM inference.

$180k - $360k

Baseten is seeking an AI Engineer to join its rapidly growing Compute organization. This role is crucial for scaling the systems and workflows that balance supply and demand across our GPU fleet. You will design, build, and ship AI-powered workflows to automate manual and repetitive tasks within the capacity lifecycle, allowing the team to focus on critical judgment calls. The ideal candidate will audit existing systems, identify gaps, and rapidly deliver solutions, thinking ahead about the broader system architecture and the role of AI in enhancing existing tooling.

$175k - $190k