performance optimization Jobs

CoreWeave is seeking a Staff Software Engineer to join the Inference Platform Team. This team builds and operates CoreWeave’s Kubernetes-native inference platform, designed for low-latency, high-throughput AI workloads at massive scale. As a technical leader, you will drive architecture, performance, and reliability across multiple services and teams. Your responsibilities will include optimizing inference performance (latency, throughput, and GPU utilization), improving system reliability, and working deeply in distributed systems and Kubernetes-based infrastructure, focusing on areas like scheduling, batching, and memory optimization. This role requires hands-on technical leadership and the ability to influence engineering direction across the organization.

$188k - $275k

NVIDIA is seeking a Senior Developer Technology Engineer to work at the forefront of AI innovation, collaborating with industry partners and open-source projects to accelerate performance for agentic AI use cases. This role offers a unique opportunity to contribute to the next era of enterprise and consumer AI by optimizing applications on RTX and DGX SoCs, influencing next-generation platforms, and providing technical guidance. You will be instrumental in identifying and resolving performance bottlenecks across various workloads, working closely with system software, GPU driver, architecture, and research teams.

$152k - $288k

NVIDIA is seeking a Senior Software Engineer to enhance the Python experience for its foundational CUDA Core Libraries. This role involves building Pythonic APIs, language bindings, algorithms, and runtime infrastructure that sit on top of native C/C++ foundations. You will contribute to the core libraries and infrastructure that make CUDA a high-performance platform for developers and AI coding agents. The position requires a strong focus on designing and implementing efficient, reliable, and scalable GPU-accelerated software, with an emphasis on improving the Python developer experience through robust tooling and clear documentation.

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to enhance the Rust experience for CUDA Core Libraries. This role involves designing and implementing safe, idiomatic Rust APIs for GPU computing, while integrating closely with existing C/C++ components. You will be part of the team responsible for building the foundational libraries, algorithms, and infrastructure that power CUDA, ensuring a high-performance experience for developers and AI coding agents.

$184k - $357k

We are seeking a Senior AI Developer Technology (DevTech) Engineer to accelerate the frontier of generative AI training and inference. Our team bridges the NVIDIA platform with developers worldwide, diving deep into customer projects to eliminate bottlenecks and partnering with the developer community to deliver optimal performance on NVIDIA systems. If you are passionate about accelerating advanced AI models and influencing the future of NVIDIA hardware and software, we want you on our team.

$184k - $357k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are looking for a Lead Software Systems Engineer - GPU Performance to play a key role in building our hyperscaler platform. This role involves analyzing and optimizing the performance of large-scale GPU clusters at the intersection of hardware and software, operating across the full stack from hardware and system software to networking, virtualization, and distributed communication layers.

$170k - $300k

Anthropic

The Encodings Infra team at Anthropic maintains the libraries that engineers and researchers use to encode text and multimodal data for Claude. This team also defines Claude's prompt structure, including how user turns are represented and how Claude interacts with tools. As a Software Engineer on this team, you will be responsible for the design and upkeep of these libraries, ensuring their APIs are intuitive, performance is optimized, and abstractions are robust. Your work will span across various systems, from pretraining to finetuning and the API, requiring close collaboration with researchers and engineers to facilitate the rapid transition of new encoding ideas from experimentation to production.

$320k - $405k

OpenAI

We are seeking an AI Systems Engineer to join our pAGI Infra team, which builds and operates the systems essential for large-scale model training and evaluation. This role involves owning projects from identifying bottlenecks and designing solutions to deployment and operation, focusing on distributed systems engineering, performance optimization, and collaboration with researchers. You will directly contribute to improving the speed and reliability of research by potentially building shared grading services, optimizing resource allocation, or integrating new training stacks into production.

$266k - $500k