Model Serving Jobs

Decagon is seeking a Senior Research Engineer focused on Safety to ensure the reliability and controllability of their AI agents. This role involves identifying real-world failure modes and developing the necessary models, evaluations, and safeguards to prevent them. The ideal candidate will be a strong engineer passionate about advancing applied AI safety in production, taking ownership of their work from end-to-end, and making high-impact technical decisions.

$200k - $400k

Blissway is a startup focused on simplifying toll collection and improving highway safety through deep tech, AI/ML, hardware, SaaS, and IoT. We have established a significant technological lead in the tolling industry, a market projected to double in the next decade. Our lean team operates across the entire system, from roadside cameras to final billing, ensuring every vehicle processed results in an accurate toll transaction. We are seeking an engineer who is passionate about shipping models into production and owning the full lifecycle from raw sensor data to deployment monitoring, cloud to edge. This role is ideal for someone who thrives on taking models from a notebook to real-world application.

$145k - $195k

Anthropic

Anthropic is building reliable, interpretable, and steerable AI systems to be safe and beneficial for users and society. This role leads a team of engineers focused on the critical control plane for Anthropic's inference fleet. This involves making key decisions about request routing and capacity allocation to meet throughput, reliability, and latency goals. The team designs placement and load-balancing algorithms, builds quantitative models for demand and performance, and optimizes latency across various system boundaries. The Engineering Manager will guide a team of ML platform, infrastructure, and distributed systems engineers, ensuring the efficiency, reliability, and evolution of the entire request-to-model path.

$405k - $625k

NVIDIA is seeking outstanding senior engineers to work on the CUDA driver, a key component of accelerated GPU computing. You will join a versatile software engineering team that delivers innovative software features to unlock the full potential and performance of NVIDIA hardware across diverse workloads like deep learning, scientific research, autonomous vehicles, gaming, and virtual reality. This multi-functional role requires collaboration with hardware architects, deep learning specialists, and both internal and external partners to advance the CUDA architecture. With the opportunity to collaborate with teams across the whole NVIDIA computing stack, you will help design software solutions across kernel mode components, compilers, and networking software. Your system-level expertise and creativity in solving complex problems will help invent the future of CUDA and NVIDIA’s compute technologies! Does crafting solutions to influence the evolution of GPU-accelerated computing sound exciting? If so, we invite you to join us and help engineer the next wave of innovation at NVIDIA!

$152k - $288k