BF16 Jobs

CoreWeave is seeking a Senior Software Engineer I, Inference to join their AI Cloud team. This role involves owning specific areas of the inference platform, leading design efforts, and improving latency, throughput, and reliability. You will collaborate with product, orchestration, and hardware teams to enhance a Kubernetes-native inference platform and meet strict service level agreements at scale. The position requires a strong focus on engineering standards, incident management, and mentoring junior engineers.

$139k - $204k

CoreWeave is seeking a Senior Software Engineer focused on Inference to join their team. In this role, you will be an area owner, responsible for leading designs, elevating engineering standards, and delivering significant improvements in latency, throughput, and reliability across multiple services. You will collaborate with product, orchestration, and hardware teams to enhance our Kubernetes-native inference platform and meet stringent P99 SLAs at scale. This is an opportunity to work on a cutting-edge AI cloud platform during a period of hyper-growth, contributing to innovative solutions for complex problems.

$152k - $204k

CoreWeave is seeking a Staff Software Engineer to join the Inference Platform Team. This team builds and operates CoreWeave’s Kubernetes-native inference platform, designed for low-latency, high-throughput AI workloads at massive scale. As a technical leader, you will drive architecture, performance, and reliability across multiple services and teams. Your responsibilities will include optimizing inference performance (latency, throughput, and GPU utilization), improving system reliability, and working deeply in distributed systems and Kubernetes-based infrastructure, focusing on areas like scheduling, batching, and memory optimization. This role requires hands-on technical leadership and the ability to influence engineering direction across the organization.

$188k - $275k

We are a dedicated research lab focused on building, understanding, using, and risk-managing foundation models. Our mission is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you will work on the core of cutting-edge foundation model training alongside world-class researchers, data scientists, and engineers. You will tackle fundamental and impactful challenges in AI development, contributing to groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills are essential for establishing our institution as a global hub for high-performance computing in deep learning.

$150k - $450k

Thinking Machines is seeking an infrastructure research engineer to design and build the core systems that enable efficient large-scale model training, with a particular focus on numerics. This role involves improving the numerical foundations of their distributed training stack, from precision formats and kernel optimizations to communication frameworks, ensuring the stability, scalability, and speed of training trillion-parameter models. The ideal candidate will excel at the intersection of research and systems engineering, possessing a strong understanding of both optimization mathematics and the practicalities of distributed compute.

$350k - $475k