gRPC Jobs
10 open roles mentioning gRPC
Software Engineer, Inference
CoreWeave
CoreWeave is seeking a Junior Software Engineer to join their Inference team. In this role, you will be responsible for the end-to-end ownership of a production service, including feature development, maintenance of dashboards and alarms, and operational improvements. You will collaborate with cross-functional teams to enhance key service level indicators and contribute to the development of a cutting-edge inference platform that powers generative AI and real-time applications at scale.
$120k - $160k
Senior Staff Software Engineer, Agentic Systems - Moveworks
Moveworks
Moveworks is building the runtime infrastructure that powers its AI agents, which are responsible for orchestrating, executing, and delivering responses to millions of enterprise users in real time. This is a distributed systems engineering role focused on the core systems that enable AI agents to plan, execute multi-step workflows, call tools, and interact with users while maintaining correctness, observability, and low latency. The systems you will build and own are central to this agentic AI wave.
$201k - $352k
Senior Software Engineer, Backend (AI Agent)
Cresta
As a Senior Software Engineer, you will be responsible for ensuring Cresta's AI Agents are supported by the most reliable and scalable server solutions. This involves designing and maintaining the server architecture to handle high-volume, real-world interactions with a focus on high availability and performance. While the role emphasizes server optimization and data management over pure research, you will work with advanced cloud and server technologies. This is a significant opportunity to influence the future of AI at Cresta by tackling complex challenges and deploying cutting-edge AI advancements into production.
$205k - $270k
Tech Lead, Systems & Platform Applied AI
Mercor
Mercor is a leading AI data company that organizes human intelligence to power the AI economy. We build the layer between human expertise and frontier models, enabling millions of domain experts to train AI models at scale. As a Tech Lead for the Applied AI Backend Systems, you will own critical services within our platform, focusing on designing data models, building APIs and services, and developing data pipelines that ensure reliable, fast, and observable operations. This is a hands-on build role where you will take ambiguous problems, make design decisions, ship to production, and mentor other engineers.
$250k - $500k
Staff Software Engineer, Inference API
Cerebras
Cerebras is developing a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are seeking a Software Engineer to build and enhance the ML API layer, making this heterogeneous serving system accessible, reliable, and user-friendly. You will operate across our inference APIs, model integration layer, request-routing services, and the Cerebras inference platform to ensure a consistent experience across various models and accelerator backends. This role is at the intersection of machine learning systems, API design, model serving, and distributed systems, enabling new model architectures and inference capabilities while defining stable user-facing behavior and ensuring features like streaming, sampling, tool use, structured outputs, and multimodal inputs function correctly in production.
Staff Python Engineer (Modeling & Simulation)
Code Metal
Code Metal is seeking a Staff Python Engineer to join their Modeling & Simulation team. This role will focus on building the Python services, pipelines, and tooling that drive a next-generation wargaming and decision-support platform. You will design backend services and APIs, integrate with simulators, manage data, and expose results to analysts and government stakeholders. The position involves developing backend infrastructure that interfaces with AI and machine learning pipelines, designing scenario-generation and analysis workflows, and building distributed, cloud-scale infrastructure to support simulations across various environments while ensuring reproducibility and model provenance. Strong command of cloud services and distributed architectures is essential.
$200k - $250k
Principal Python Engineer (Modeling & Simulation)
Code Metal
Code Metal is seeking a Principal Python Engineer to join their Modeling & Simulation team. This role will focus on building the Python services, pipelines, and tooling that drive the core wargaming simulation for a next-generation decision-support platform. You will design backend services and APIs that interface with the frontend, integrate with simulators, manage data, and expose results to analysts and government stakeholders. The position involves developing backend infrastructure that interfaces with agentic AI and machine learning pipelines, designing scenario-generation and campaign-evaluation workflows, and building distributed, cloud-scale infrastructure for running simulations. Strong command of cloud services and distributed architectures is essential.
$250k - $290k
Senior Software Engineer, Agentic Systems - Moveworks
Moveworks
Moveworks is building the runtime infrastructure that powers its AI agents, which deliver real-time responses to millions of enterprise users. This role focuses on distributed systems engineering at the core of agentic AI. The AI agents can plan, execute multi-step workflows, call tools, and interact with users while maintaining correctness, observability, and low latency. The systems responsible for these capabilities are what you will build and own.
Staff Software Engineer, Agentic Systems - Moveworks
Moveworks
Moveworks is building the runtime infrastructure that powers its AI agents, enabling them to orchestrate, execute, and deliver responses to millions of enterprise users in real time. This role focuses on distributed systems engineering at the forefront of agentic AI. The AI agents are designed to plan, execute multi-step workflows, call tools, and interact with users, all while ensuring correctness, observability, and low latency. The successful candidate will build and own the systems that make these advanced agent capabilities possible.
Senior Staff Software Engineer, Agentic Systems - Moveworks
Moveworks
Moveworks is building the runtime infrastructure that powers its AI agents, which are responsible for orchestrating, executing, and delivering responses to millions of enterprise users in real time. This role focuses on distributed systems engineering at the forefront of agentic AI. The AI agents are designed to plan and execute multi-step workflows, interact with tools, and manage human input, all while ensuring correctness, observability, and low latency. The systems responsible for these capabilities are what you will build and own.
