AI inference Jobs

4 open roles mentioning AI inference

System Engineer (Token Factory)

2d ago
N

Nebius

Nebius is building a full-stack AI cloud platform to support developers and enterprises in the global AI economy. We are focused on solving complex problems across compute, storage, networking, and applied AI. The Token Factory team is developing a cutting-edge inference platform designed to make various foundation models (text, vision, audio, and multimodal) fast, reliable, and effortlessly deployable at massive scale.

Austin, Texas, United States; Remote; Remote - Europe remote
CUDAMachine LearningGPU +2 more

Senior Director of Engineering - Inference Serving

3d ago
S

SambaNova

The SambaStack team is seeking an Engineering Director to lead a software engineering team while remaining a hands-on technical contributor. You will own the growth and effectiveness of your team, the technical quality of their output, and the roadmap for the inference serving platform. You will continue to design systems and write code on the platform's hardest problems, contributing directly as a software engineer on critical platform initiatives.

$245k - $325k

San Jose, California, United States onsite
KubernetesPythonGo +5 more

Senior Developer Relations Manager - Dynamo AI Inference

21d ago
n

nvidia

We are seeking a Senior Developer Relations Manager to build the developer ecosystem around NVIDIA Dynamo, an open-source framework for distributed AI inference. In this senior individual contributor role, you will help developers deploy and operate inference systems, build practical technical resources, and represent developer needs both in the community and inside NVIDIA. You will build the ecosystem with various inference projects through joint demos, integration guides, upstream contributions, and community programs. You will also develop runnable demos, sample code, technical documentation, and videos to explain Dynamo’s modular ecosystem and demonstrate its data center performance value. Additionally, you will represent the developer community inside NVIDIA by translating feedback into engineering and product requirements, influencing priorities, and communicating progress back to developers. You will advocate externally through technical talks, live demos, workshops, and office hours, helping developers troubleshoot real deployments and contribute to projects.

$184k - $357k

US, CA, Santa Clara remote
KubernetesPythonModel Serving +7 more

Software Architect

28d ago
S

SambaNova

SambaNova is seeking a Software Architect to join the SambaStack platform team. This role involves defining the technical direction and architectural strategy for an AI inference platform that serves enterprise AI workloads on SambaNova's RDU hardware. You will own cross-cutting architectural decisions, ensuring the platform meets enterprise-grade standards for scalability, reliability, and performance. This is a high-impact position at the intersection of AI infrastructure, enterprise software, systems architecture, and developer experience.

$245k - $325k

San Jose, California, United States onsite
KubernetesPythonGo +4 more

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.