gRPC Jobs

10 open roles mentioning gRPC

Software Engineer, Inference

1d ago
C

CoreWeave

CoreWeave is seeking a Junior Software Engineer to join their Inference team. In this role, you will be responsible for the end-to-end ownership of a production service, including feature development, maintenance of dashboards and alarms, and operational improvements. You will collaborate with cross-functional teams to enhance key service level indicators and contribute to the development of a cutting-edge inference platform that powers generative AI and real-time applications at scale.

$120k - $160k

Sunnyvale, CA / Bellevue, WA remote
KubernetesPythonGo +8 more

Senior Staff Software Engineer, Agentic Systems - Moveworks

7d ago
M

Moveworks

Moveworks is building the runtime infrastructure that powers its AI agents, which are responsible for orchestrating, executing, and delivering responses to millions of enterprise users in real time. This is a distributed systems engineering role focused on the core systems that enable AI agents to plan, execute multi-step workflows, call tools, and interact with users while maintaining correctness, observability, and low latency. The systems you will build and own are central to this agentic AI wave.

$201k - $352k

Mountain View, CALIFORNIA, United States remote Full-time
PythonGoAI Agents +9 more

Senior Software Engineer, Backend (AI Agent)

10d ago
C

Cresta

As a Senior Software Engineer, you will be responsible for ensuring Cresta's AI Agents are supported by the most reliable and scalable server solutions. This involves designing and maintaining the server architecture to handle high-volume, real-world interactions with a focus on high availability and performance. While the role emphasizes server optimization and data management over pure research, you will work with advanced cloud and server technologies. This is a significant opportunity to influence the future of AI at Cresta by tackling complex challenges and deploying cutting-edge AI advancements into production.

$205k - $270k

United States (Remote) remote
AWSAzureGoogle Cloud +7 more

Tech Lead, Systems & Platform Applied AI

1mo ago
M

Mercor

Mercor is a leading AI data company that organizes human intelligence to power the AI economy. We build the layer between human expertise and frontier models, enabling millions of domain experts to train AI models at scale. As a Tech Lead for the Applied AI Backend Systems, you will own critical services within our platform, focusing on designing data models, building APIs and services, and developing data pipelines that ensure reliable, fast, and observable operations. This is a hands-on build role where you will take ambiguous problems, make design decisions, ship to production, and mentor other engineers.

$250k - $500k

San Francisco onsite FullTime
AnthropicPythonGraphQL +8 more

Staff Software Engineer, Inference API

1mo ago
C

Cerebras

Cerebras is developing a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are seeking a Software Engineer to build and enhance the ML API layer, making this heterogeneous serving system accessible, reliable, and user-friendly. You will operate across our inference APIs, model integration layer, request-routing services, and the Cerebras inference platform to ensure a consistent experience across various models and accelerator backends. This role is at the intersection of machine learning systems, API design, model serving, and distributed systems, enabling new model architectures and inference capabilities while defining stable user-facing behavior and ensuring features like streaming, sampling, tool use, structured outputs, and multimodal inputs function correctly in production.

Sunnyvale, CA remote FullTime
OpenAIKubernetesPython +8 more

Staff Python Engineer (Modeling & Simulation)

1mo ago
C

Code Metal

Code Metal is seeking a Staff Python Engineer to join their Modeling & Simulation team. This role will focus on building the Python services, pipelines, and tooling that drive a next-generation wargaming and decision-support platform. You will design backend services and APIs, integrate with simulators, manage data, and expose results to analysts and government stakeholders. The position involves developing backend infrastructure that interfaces with AI and machine learning pipelines, designing scenario-generation and analysis workflows, and building distributed, cloud-scale infrastructure to support simulations across various environments while ensuring reproducibility and model provenance. Strong command of cloud services and distributed architectures is essential.

$200k - $250k

San Francisco Hub remote FullTime
AWSAzureGoogle Cloud +7 more

Principal Python Engineer (Modeling & Simulation)

1mo ago
C

Code Metal

Code Metal is seeking a Principal Python Engineer to join their Modeling & Simulation team. This role will focus on building the Python services, pipelines, and tooling that drive the core wargaming simulation for a next-generation decision-support platform. You will design backend services and APIs that interface with the frontend, integrate with simulators, manage data, and expose results to analysts and government stakeholders. The position involves developing backend infrastructure that interfaces with agentic AI and machine learning pipelines, designing scenario-generation and campaign-evaluation workflows, and building distributed, cloud-scale infrastructure for running simulations. Strong command of cloud services and distributed architectures is essential.

$250k - $290k

San Francisco Hub onsite FullTime
AWSAzureGoogle Cloud +7 more

Senior Software Engineer, Agentic Systems - Moveworks

1mo ago
M

Moveworks

Moveworks is building the runtime infrastructure that powers its AI agents, which deliver real-time responses to millions of enterprise users. This role focuses on distributed systems engineering at the core of agentic AI. The AI agents can plan, execute multi-step workflows, call tools, and interact with users while maintaining correctness, observability, and low latency. The systems responsible for these capabilities are what you will build and own.

Mountain View, CALIFORNIA, United States remote Full-time
PythonGoLLM +10 more

Staff Software Engineer, Agentic Systems - Moveworks

1mo ago
M

Moveworks

Moveworks is building the runtime infrastructure that powers its AI agents, enabling them to orchestrate, execute, and deliver responses to millions of enterprise users in real time. This role focuses on distributed systems engineering at the forefront of agentic AI. The AI agents are designed to plan, execute multi-step workflows, call tools, and interact with users, all while ensuring correctness, observability, and low latency. The successful candidate will build and own the systems that make these advanced agent capabilities possible.

Mountain View, CALIFORNIA, United States remote Full-time
PythonGoAI Agents +8 more

Senior Staff Software Engineer, Agentic Systems - Moveworks

1mo ago
M

Moveworks

Moveworks is building the runtime infrastructure that powers its AI agents, which are responsible for orchestrating, executing, and delivering responses to millions of enterprise users in real time. This role focuses on distributed systems engineering at the forefront of agentic AI. The AI agents are designed to plan and execute multi-step workflows, interact with tools, and manage human input, all while ensuring correctness, observability, and low latency. The systems responsible for these capabilities are what you will build and own.

Mountain View, CALIFORNIA, United States remote Full-time
PythonGoAI Agents +9 more

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.