Inference Jobs

Crusoe is seeking a Senior Production Engineer to join their team and ensure the reliability and scalability of their AI-optimized cloud platform. This role is crucial for building and operating managed AI services at scale, focusing on delivering highly available, performant, and cost-efficient AI infrastructure for compute-intensive, latency-sensitive workloads. The ideal candidate will have a strong background in distributed systems and hands-on experience with large language models, contributing to the future of AI infrastructure.

$170k - $205k

We are seeking a Senior AI Developer Technology (DevTech) Engineer to accelerate the frontier of generative AI training and inference. Our team bridges the NVIDIA platform with developers worldwide, diving deep into customer projects to eliminate bottlenecks and partnering with the developer community to deliver optimal performance on NVIDIA systems. If you are passionate about accelerating advanced AI models and influencing the future of NVIDIA hardware and software, we want you on our team.

$184k - $357k

Cohere

Cohere is seeking a Staff Forward Deployed Engineer to bridge the gap between frontier AI capabilities and complex customer realities. This role involves architecting high-performance, resilient machine learning systems within enterprise environments, acting as the primary technical liaison between Cohere's core engineering teams and strategic partners. You will own the architecture for customer-specific inference challenges, ensuring our large language models operate reliably, securely, and at peak performance within client infrastructure. The goal is to achieve exceptionally low latency, high throughput, and seamless resilience in production deployments.

$240k - $415k

SpaceXSI is building one of the world's largest AI supercomputers from the ground up. As part of the Compute Infrastructure team, you will own both the raw GPU supercomputer and the platform layer that runs on top of it. You will work across the full stack—from low-level GPU kernel optimizations and Linux kernel internals to massive-scale orchestration and virtualization—to make training and inference at SpaceXSI as fast, reliable, and scalable as possible. This is a broad, high-impact role that combines hardcore supercompute and compute infrastructure work. Your contributions will directly accelerate Grok's training speed and overall AI progress.

$180k - $440k

You'll join the Grok Voice Model team as a software engineer. You'll design, build, and run the software systems behind Grok Voice, which delivers natural, low-latency, multilingual spoken interactions across devices and in real time. The team owns the full engineering stack behind the model, from large-scale data processing to distributed training to production deployment.

$150k - $450k

NVIDIA is seeking a Senior Validation Engineer to join the DGX Server Product Engineering Team. In this role, you will collaborate with a team of hardware and software engineers to develop and implement sophisticated automated test plans for our leading GPU-accelerated computing products. You will be instrumental in ensuring the performance and reliability of cutting-edge AI hardware by developing and tuning workloads, adapting state-of-the-art AI training and inference frameworks, and applying architectural analysis to characterize workload behavior and identify bottlenecks. This position offers the opportunity to make a significant impact on the future of computing by working on AI-driven technologies.

$136k - $259k

SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack, from supercomputers to Grok models and a suite of applications. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next. The RL infrastructure team is looking for an engineer to help with low precision RL training and inference.

$180k - $440k

Figma is seeking a hands-on engineering leader to manage and grow its AI Infrastructure team. This team builds the foundational inference systems that power Figma's AI products, ensuring reliability, observability, and seamless integration of cutting-edge models. The role involves defining and executing technical strategy, collaborating across engineering, and directly contributing to the core AI platform. This is an opportunity to join a rapidly growing team at the ground floor and shape the future of AI at Figma.

$258k - $376k

SpaceXSI is building the high-performance inference platform that serves Grok to millions of users daily with exceptional speed and reliability. As a Member of Technical Staff - Inference, you will be instrumental in designing and optimizing large-scale model serving systems from the ground up. This includes owning distributed infrastructure components like global KV cache, continuous batching, load balancing, and auto-scaling, as well as delving into deep low-level optimizations such as GPU kernels, quantization, and speculative decoding. This is a high-impact role where your contributions will directly influence the speed and reliability of user interactions with Grok at a massive scale.

$180k - $440k

NVIDIA is seeking a Senior Software Engineer to focus on AI Inference Performance, advancing innovative LLM and VLM inference on NVIDIA GPU-accelerated systems. This hands-on role involves pushing workloads to practical performance limits, delivering measurable gains in latency, throughput, efficiency, and scale. You will translate performance models and profiler data into working code, collaborating with various teams and contributing improvements to open-source inference engines. Your work will directly impact production deployments and help shape future NVIDIA platforms.

$184k - $357k

Nebius is building a full-stack AI cloud platform to support developers and enterprises in the global AI economy, from data and model training through to production deployment. The Nebius Token Factory is seeking scientists to tackle frontier LLM and VLM inference bottlenecks by turning them into research questions, conducting rigorous experiments, and translating findings into production capabilities. You will own focused research and optimization projects, write strong code, and produce prototypes, publications, and technical artifacts for engineers to build upon. Your research will cover areas like quantization, distillation, speculative decoding, KV-cache optimization, and model/runtime co-optimization, alongside inference engines and distributed inference architectures. You will evaluate trade-offs across model quality, latency, throughput, memory footprint, and cost per token, and collaborate with engineering teams to bring promising results into production.

$195k - $262k

Nebius is a leading cloud infrastructure provider for the global AI economy, building a full-stack AI cloud platform. We are seeking a Senior Customer AI Engineer to join our Token Factory team. This role focuses on helping customers successfully transition their AI workloads from proof-of-concept to production and scale them on Nebius infrastructure. You will operate at the intersection of engineering, delivery, and customer success, ensuring reliable, performant, and cost-efficient deployments. You will collaborate closely with customer engineering teams, Solution Architects, and Product/Infrastructure teams.

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are looking for a Senior Customer AI Engineer to join our Token Factory team. This role is at the intersection of engineering, delivery, and customer success, ensuring that customer AI workloads transition smoothly from proof-of-concept to production and scale reliably on Nebius infrastructure. You will work closely with customer engineering teams, Solution Architects, and Product/Infrastructure teams to drive stable, performant, and cost-efficient deployments.

$210k - $262k

OpenAI

OpenAI's Forward Deployed Engineering team partners with customers to turn research breakthroughs into production systems, operating at the intersection of customer delivery and core platform development. As a Forward Deployed Engineer for AI Infra, you will lead complex deployments of frontier models in production, embedding with customers where model performance and urgent delivery are critical. You will work directly with customer engineers, researchers, and product engineers on optimization problems across semiconductors and AI infrastructure, writing and debugging software, running experiments, and improving tools. Your role involves defining problems, structuring delivery, and shipping fast, with a focus on inference performance and chip-design optimization, ultimately contributing improvements to OpenAI's platform.

$185k - $300k

We are building AI that changes how people capture, understand, and act on conversations and meetings. As Director of AI Research, you will lead research and development across automatic speech recognition (ASR), speaker identification (SID), large language models (LLMs), and audio language models. Your work will shape our AI capabilities, product direction, and long-term research strategy. This is a hands-on leadership role for someone who combines research depth with experience building and deploying AI systems at scale. You will set technical priorities, guide model and infrastructure decisions, and work directly with the team on challenging research and engineering problems. Partnering closely with Product, Engineering, and Data teams, you will turn research advances into reliable product capabilities. You will also build the team, experimentation practices, and technical foundation needed to move quickly while maintaining high standards for quality and performance.

$244k - $313k

NVIDIA's TensorRT team is seeking a Senior AI-Native Systems Software Engineer to lead a groundbreaking initiative focused on making TensorRT the global standard for out-of-framework inference. This role involves developing a novel, AI-native framework designed to leverage AI agents for producing high-performance, high-quality C++ software at scale. The ideal candidate is a systems-thinking C++ engineer passionate about advancing agentic development frameworks, staying abreast of deep learning advancements, and enhancing user experience through rapid model onboarding.

$152k - $288k

You will design and build the core infrastructure that powers AI inference across Cloudflare's global network. This includes real-time voice, frontier open LLMs, and customer-deployed models running on a heterogeneous fleet of GPUs and next-generation accelerators. You will work alongside AI/ML engineers, hardware partners, and Cloudflare product teams to solve complex problems in distributed systems and high-performance computing. The role involves addressing challenges such as sub-second model cold starts, multi-accelerator workload scheduling, efficient KV cache management, and developing a model deployment platform for both internal use and customer models. This is an opportunity to be at the center of building a novel AI inference platform embedded in the fabric of the internet, defining how AI runs at the edge of the network.

$194k - $266k

You will help define how machine learning models run across Cloudflare’s global network, from frontier open LLMs and real-time voice models to customer-deployed models served on heterogeneous GPUs and next-generation accelerators. You’ll work with systems engineers, product teams, hardware partners, and AI/ML engineers to bring models into production with low latency, strong reliability, and efficient resource use. This role combines applied ML, inference optimization, evaluation, and production engineering, with a focus on benchmarking models, improving serving performance, validating quality, and building tooling that helps Cloudflare and its customers ship AI applications at Internet scale.

$194k - $266k

Together AI

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and company growth.

$270k - $300k

Anthropic

As a TPU Kernel Engineer, you will be responsible for identifying and addressing performance issues across various ML systems, including research, training, and inference. A significant part of this role involves designing and optimizing kernels specifically for the TPU. You will also provide crucial feedback to researchers regarding how model changes affect performance. The ideal candidate will have a proven history of solving large-scale systems problems and demonstrating expertise in low-level optimization.

$280k - $850k