ML infrastructure Jobs

Perplexity is seeking software engineers to join our Training Infrastructure team. This team is responsible for large-scale RL and agent evaluation platforms that enable the company to train state-of-the-art models and optimize agent harnesses. As a full-stack engineer on this team, you will build distributed systems that orchestrate AI workloads across global-scale compute infrastructure, define novel user and agent interfaces for designing, managing, and launching experiments, and create tools that make experiment results legible to humans and agents alike. A strong candidate will possess both experience and passion for solving difficult problems at the intersection of AI, distributed systems, and research acceleration.

$220k - $405k

The Knowledge Architecture team at CoreWeave is responsible for how the Product and Engineering organization captures, structures, and shares information. This team builds internal documentation, onboarding content, and technical education programs to help engineers find answers and become productive quickly. They also establish standards and create the ontology infrastructure to maintain knowledge accuracy as the company scales. As a Knowledge Architect, you will contribute dedicated documentation and knowledge infrastructure capacity, writing and maintaining technical documentation for Product and Engineering teams, including systems documentation, workflows, runbooks, and guides. You will also build and maintain onboarding content for new engineers and work with subject matter experts to capture undocumented knowledge.

$134k - $179k

SambaNova is seeking a Senior Software Engineer to join the ML Infrastructure team. This role is central to our mission as an inference-first company, focusing on designing, building, and operating the production-grade inference infrastructure that powers SambaNova's serving stack on our Reconfigurable Dataflow Unit (RDU) architecture. You will transform state-of-the-art inference techniques into reliable, high-throughput, low-latency services exposed to customers through SambaStack and SambaCloud. This position involves end-to-end ownership of systems including request scheduling, advanced decoding algorithms, caching layers, API surfaces, and accuracy infrastructure, and requires close collaboration with ML, compiler, runtime, and product teams.

$200k - $275k

Plaid is seeking a Staff Machine Learning Engineer to join the Data Foundation & AI team. This team builds the shared ML and AI infrastructure that powers intelligent capabilities across Plaid's product suite, transforming unique financial network data into scalable, general-purpose representations. The role involves working at the intersection of machine learning infrastructure, applied AI, and distributed systems to establish the core AI platform that enables innovation. The Staff ML Engineer will lead the technical strategy and development of Plaid’s foundation models, driving key decisions across pretraining objectives, model architecture, and fine-tuning approaches. This position requires establishing rigorous evaluation frameworks, building scalable pipelines, and partnering with teams across the organization to define product integrations with foundation models. As a senior technical leader, you will mentor engineers, elevate engineering standards, and represent Plaid's AI and machine learning capabilities externally.

$249k - $368k

Chai Discovery is building the computer-aided design suite for molecules, with major pharmaceutical companies already using their platform to accelerate drug discovery. They are at the forefront of reinventing life sciences through AI, developing frontier models that understand biochemical structure and interaction. This role is an opportunity to push the boundaries of AI drug design alongside a skilled and dedicated team.

Together AI

Together AI is building the best inference infrastructure for voice applications, powering production-grade, real-time voice agents and applications with best-in-class latency and reliability for speech-to-text and text-to-speech models. We are seeking a Staff ML Engineer to lead the model serving layer for voice workloads. This role involves hands-on optimization of inference engines and models, profiling GPU utilization, designing batching strategies for streaming audio, and ensuring rapid deployment of new model architectures from research to production. This is a foundational hire on a small, high-impact team, addressing the unique challenges of voice inference such as streaming audio, tokenization, and real-time latency budgets, and shaping the future of voice model serving.

$220k - $280k

OpenAI

We are seeking an AI Systems Engineer to join our pAGI Infra team, which builds and operates the systems essential for large-scale model training and evaluation. This role involves owning projects from identifying bottlenecks and designing solutions to deployment and operation, focusing on distributed systems engineering, performance optimization, and collaboration with researchers. You will directly contribute to improving the speed and reliability of research by potentially building shared grading services, optimizing resource allocation, or integrating new training stacks into production.

$266k - $500k

Anthropic

The Safeguards ML Inference Path team designs, builds, and operates the production infrastructure that powers Claude's ML-based safety systems. This role involves collaborating closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production, owning the research-to-production transfer of new safety technologies critical for every Claude model launch. The team builds for scale, serving thousands of ML classifiers for all requests on the token generation path and for every platform Claude runs on. Engineers will work at the intersection of machine learning, large-scale distributed systems, and AI safety, developing platforms and tools that enable safeguards to operate reliably at scale, with tooling and infrastructure used for every model launch.

$320k - $485k