Inference Jobs

Lightning AI is seeking a Senior Application Security Engineer to safeguard their AI, machine learning, and inference platforms. This is a hands-on technical role focused on integrating security into modern AI infrastructure, inference systems, and developer platforms. You will collaborate with platform engineers, ML engineers, and infrastructure teams to identify risks, design secure architectures, and develop security tooling that empowers engineers to operate efficiently and securely. The role is execution-driven, involving technical implementation, in-depth security reviews, and contributing to the growth of application security capabilities.

$180k - $220k

Anthropic

Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry’s largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms.

$320k - $485k

NVIDIA is seeking an NCX Senior Engineer to join our DSX team, collaborating closely with strategic customers to implement and enhance groundbreaking AI workloads. You will deliver hands-on technical assistance for advanced AI deployments, intricate distributed systems, and ensure customers realize efficient performance from NVIDIA's AI platform across varied environments. We partner with the world's most innovative AI companies to address their most challenging technical problems. In this role, you will develop innovative solutions that advance AI infrastructure capabilities and directly influence customer success with breakthrough AI initiatives.

$184k - $357k

Perplexity is seeking a Technical Program Manager to act as the central point of contact between our model providers, engineering, and product teams, driving the advancement of our core inference platform. This role is crucial for managing one of the industry's highest-throughput inference stacks, serving diverse traffic across a dynamic portfolio of models. You will operate at the nexus of product, engineering, and finance, coordinating the smooth integration of new models and capacity while executing the roadmap for the inference platform itself. The ideal candidate possesses strong technical acumen, excels at coordinating diverse teams and external partners with competing deadlines, and is motivated by establishing operating models for functions with limited precedent.

$170k - $265k

Anthropic

Anthropic is building reliable, interpretable, and steerable AI systems to be safe and beneficial for users and society. This role leads a team of engineers focused on the critical control plane for Anthropic's inference fleet. This involves making key decisions about request routing and capacity allocation to meet throughput, reliability, and latency goals. The team designs placement and load-balancing algorithms, builds quantitative models for demand and performance, and optimizes latency across various system boundaries. The Engineering Manager will guide a team of ML platform, infrastructure, and distributed systems engineers, ensuring the efficiency, reliability, and evolution of the entire request-to-model path.

$405k - $625k