Inference Jobs

We are seeking a dynamic, mission-driven Developer Relations Manager to engage leading university-affiliated researchers and labs. In this role, you will work directly with researchers to accelerate the adoption of NVIDIA’s sophisticated AI and computing platforms. The ideal candidate combines deep technical expertise with strong experience in research engagement and a proven track record to translate advanced technologies into valuable, insight-focused outcomes.

$152k - $288k

Physical Intelligence is building a platform to bring general-purpose AI into the physical world, powering robots with foundation models and learning algorithms. As an API Product Engineer, you will develop the core product surface that enables external companies to utilize Pi's models similarly to how they use LLM APIs today. This involves allowing them to bring their own data, fine-tune models, evaluate performance, and run low-latency inference within their own environments. You will own this entire experience, transforming close-knit collaborations into a scalable platform designed to support a vast number of robots.

Code Metal is seeking a Senior Software Engineer for its AI Platform team. This role involves designing, building, and operating the foundational AI enablement stack that powers the company's AI-driven code solutions. You will contribute to critical components such as GPU inference serving, model gateways, agent harnesses, context engineering, observability, and AI experimentation management. While this is an internal platform, it is built to product standards. The position offers the opportunity to eventually own a specific area, like model serving or agentic infrastructure, while also contributing broadly across the stack. The role requires a blend of strong software engineering skills with solid data science and AI research fundamentals, including occasional experimental work to inform platform decisions.

$170k - $210k

NVIDIA is seeking a Senior Deep Learning Software Engineer to join their Algorithmic Model Optimization Team. This role focuses on optimizing generative AI models, including LLMs and diffusion models, for maximum inference efficiency. The team utilizes techniques like neural architecture search, pruning, sparsity, and quantization, and develops an innovative software platform for automated deployment. The engineer will contribute to applied research and the development of this software, which is used both internally at NVIDIA and externally by other AI development teams. This is an opportunity to push the boundaries of inference efficiency and large-scale automated deployment, working with high-level frameworks and improving high-performance kernel implementations.

$184k - $357k

NVIDIA is at the forefront of AI, powering the next era of computing with its GPUs. This role focuses on understanding how evolving Large Language Model (LLM) architectures and inference workloads map to hardware, which is critical for designing efficient AI systems. The team utilizes simulation and agentic engineering to analyze emerging architectures and inform hardware and software development decisions.

$152k - $288k

Asana's AI organization is building the platform and products that integrate AI into how teams work. This includes AI Teammates, an orchestration layer for agents, and the AI platform supporting all Asana AI features, covering model access, retrieval, context, evaluation, and production quality. We are seeking a Senior Staff Software Engineer to lead technical direction across this organization, tackling complex cross-team challenges, making critical architectural decisions, and shaping the future of AI within Asana's products. This role involves influencing strategy across multiple engineering teams located in San Francisco, New York, Vancouver, and Warsaw.

$297k - $350k

Baseten is seeking an Engineering Manager to lead a portion of their Inference Performance team. This team is responsible for accelerating and optimizing the performance of demanding AI workloads on GPUs. The role involves managing and growing a team of inference performance engineers focused on the inference engine and runtime, including areas like kernels, scheduling, batching, KV-cache management, and speculative decoding. It's a hands-on technical leadership position where you will define the team's direction, solve complex problems, and contribute technically to GPU performance while also focusing on hiring, developing, and supporting your team members. Your team's work will directly impact customer model inference speed and serving efficiency, and you will play a key role in shaping the team's structure as it scales.

$240k - $270k

Databricks

We are seeking a Partner Engineer to manage the technical relationships with Databricks' strategic AI partners, including Anthropic, OpenAI, and Google Gemini. In this high-impact role, you will be responsible for co-owning the joint roadmap with partner product teams, driving the development of integrations that enhance both platforms, and actively engaging with new product features and tooling. You will collaborate with partners to create Proofs of Concept (POCs), demonstrations, and hands-on labs that will ultimately form the architectures our customers deploy. This position offers direct visibility to our founders and executives and sits within the Partner Engineering team, working closely with Product, Engineering, Strategic Partnerships, and Global Go-to-Market teams.

$150k - $206k

Sierra is seeking a Software Engineer for its Inference team to build the systems that power their AI agents. This role focuses on making foundation models fast, reliable, and efficient at scale. You will define the inference architecture, working on systems for serving, routing, capacity management, and optimization for latency, reliability, and cost. This is a systems-first role at the intersection of distributed infrastructure and AI, requiring strong distributed systems fundamentals and experience with complex systems problems.

$230k - $390k

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are seeking distributed systems engineers and product-minded generalists to build the distributed runtime that powers large-scale LLM inference on Baseten. Our inference platform ensures customers can deploy and operate advanced models with industry-leading performance, scalability, and reliability. You will work across the entire stack, from the developer experience for model deployment to the systems orchestrating Kubernetes and routing traffic efficiently, ensuring every model on our platform is fast, reliable, and cost-efficient.

$180k - $360k

At Mach9, ML infrastructure engineers build and maintain the systems that power production AI models for civil engineering and surveying. Our ML pipeline spans 10,000+ miles of labeled survey data, image segmentation networks, and 3D prediction models serving real-time inference to surveyors and engineers in the field. This role is ideal for mid-career ML infrastructure engineers with experience building for both training and inference. You'll build training pipelines that handle deep transformer models on hundreds of terabytes of 3D point cloud and image data. You'll also architect our inference infrastructure, delivering both heavy offline detection algorithms and real-time responsive inference that integrates directly with our CAD software.

$160k - $250k

Runpod is seeking a Senior ML Systems Engineer focused on Inference to lead efforts in making LLM inference the fastest and most cost-efficient on their platform. This role involves owning LLM serving performance end-to-end, measuring, understanding, and improving it across various models, hardware, and workloads. The work directly impacts customer latency and cost, requiring a hands-on approach to identify and fix bottlenecks, and ensure reliable production deployment. The ideal candidate will be passionate about AI infrastructure and contribute to building the platform for the next generation of AI developers.

$150k - $220k

Anthropic

Reinforcement learning (RL) is crucial for Claude's ability to reason, write code, and act autonomously over long horizons. This role is part of the team responsible for building and maintaining the RL training system, which is used to train production models and for researchers across Anthropic to run their experiments. The team collaborates closely with research teams company-wide on the science and engineering required to scale RL effectively. As a Research Engineer, you will be at the heart of RL at Anthropic, with a direct view of RL training at the frontier, as the system you own supports both production and research runs. You will work with collaborators across research teams to understand system performance, identify areas of fragility, and drive future improvements.

$500k - $850k

OpenAI

We are seeking a software engineer to build and evolve our classification and evaluation platform. You will develop services, online and offline pipelines, and tools that help researchers and data scientists turn an idea into a working measurement and iterate on it quickly. This role combines software and data engineering with hands-on production ownership. You will shape the architecture, deliver new capabilities, improve inference efficiency, and keep the system dependable as workloads and requirements evolve. Strong candidates will bring deep software engineering expertise and an interest in building a technical product in close partnership with its users.

$347k - $445k

We are seeking a Developer Relations Manager to be the primary liaison between our developers, customers, and the Jetson SW stack. This role involves guiding users through the platform, including BSP, security, OTA, real-time workloads, mixed-criticality systems, AI libraries, and agentic AI. You will work directly with developers and customers to help them build and deploy optimized edge AI and robotics solutions on Jetson. Simultaneously, you will gather their challenges and insights to inform our engineering and product teams, directly shaping the platform's roadmap.

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to lead the bring-up, triage, benchmarking, analysis, and optimization of distributed training and inference workloads across NVIDIA GPU platforms at the largest scales. In this role, you will set technical direction for communication libraries, model frameworks, and inference/training stacks to ensure state-of-the-art LLM workloads run efficiently and reliably at scale. You will lead deep performance and reliability investigations on multi-GPU and multi-node deployments, define how new platforms are benchmarked and qualified, and build the resilience and failure-attribution capabilities essential for large clusters. This is a hands-on, senior individual-contributor role for an engineer experienced at the intersection of deep learning systems, GPU performance, distributed computing, and large-scale operations.

$184k - $357k

Artificial intelligence is shifting from passive help to autonomous, always-on workflows. Our mission is to make this change seamless, efficient, and secure for millions globally. We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX GPUs. You will guide development so open-source AI agents operate locally, safely, and efficiently on consumer PCs. By combining powerful local inference with strong privacy routers and sandboxed execution, you will help develop the foundation of the desktop AI operating system.

$184k - $357k

Anthropic

The Cloud Inference team is responsible for scaling and optimizing Claude to serve massive audiences of developers and enterprise companies across major cloud platforms like AWS, GCP, and Azure. Within this team, the model & inference launch team focuses on the validation pipeline for inference servers and load balancers. This critical infrastructure work ensures that every inference change, including new model launches and performance improvements, is deployed with correctness, performance, and reliability. The goal is to make validation fast, cost-effective, and trustworthy, directly impacting how quickly advanced models and features reach users on all cloud platforms and how efficiently compute resources are utilized.

$320k - $485k

Mirage is seeking an ML Engineer to build and scale the systems powering their video generation models. This role sits at the intersection of research and systems engineering, focusing on making advanced models faster, more efficient, and capable of ultra-low latency, real-time generation. You will work on novel modeling approaches, training objectives, scaling strategies, and inference optimization and efficiency to bring cutting-edge models into production.

$175k - $300k

Anthropic

Anthropic's production models undergo sophisticated post-training processes to enhance their capabilities, alignment, and safety. Decisions in production training depend on knowing how the model is really behaving. This role's mission is to have the best observability into production post-training runs at Anthropic, providing the clearest, most trusted view of model quality during training. You will shape what gets measured, keep the signal trustworthy and timely, and investigate surprising results to inform post-training and release decisions.

$500k - $850k