NCCL Jobs

36 open roles mentioning NCCL

Principal Engineer - Perf and Benchmarking

19h ago
C

CoreWeave

CoreWeave is seeking a Principal Engineer to lead its Benchmarking & Performance team. This role will be responsible for a global performance data warehouse, ingesting, storing, transforming, and analyzing performance events across all data centers. You will also play a key part in industry-leading performance benchmarking publications, working closely with NVIDIA and the open-source community to demonstrate CoreWeave's performance and reliability leadership in AI.

$206k - $333k

Sunnyvale, CA / Bellevue, WA remote
KubernetesPyTorchDistributed Training +9 more

Senior Software Engineer - Perf and Benchmarking

19h ago
C

CoreWeave

CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team. This role will be instrumental in managing a planet-scale performance data warehouse, handling the ingestion, storage, transformation, and analysis of performance events across global data centers. The engineer will also contribute to industry-leading performance benchmarking publications like MLPerf. The position involves owning designs, elevating engineering standards, and driving measurable improvements in latency, throughput, and reliability across multiple services. Collaboration with product, orchestration, and hardware teams will be key to evolving the Kubernetes-native platform and meeting stringent P99 SLAs at scale.

$182k - $242k

Sunnyvale, CA / Bellevue, WA onsite
KubernetesPythonGo +9 more

Senior Deep Learning Software Engineer, Inference

1d ago
n

nvidia

NVIDIA is seeking a Senior Software Engineer to specialize in Deep Learning Inference. This role involves designing, building, and optimizing GPU-accelerated software for AI applications, focusing on high-performance deep learning frameworks like SGLang and vLLM for efficient large-scale model serving and inference. You will contribute to improving these platforms, enabling the smooth deployment of advanced language models and working with the deep learning community to implement and release the latest algorithms. The work will concentrate on enhancing the performance of state-of-the-art LLM and Generative AI models across various NVIDIA accelerators, utilizing open-source tools and kernels for optimization.

$184k - $357k

US, CA, Santa Clara onsite
PythonLLMPyTorch +11 more

Senior Software Engineer, DGX Cloud AI Infrastructure

1d ago
n

nvidia

NVIDIA is seeking a Senior Software Engineer to lead the bring-up, triage, benchmarking, analysis, and optimization of distributed training and inference workloads across NVIDIA GPU platforms at the largest scales. In this role, you will set technical direction for communication libraries, model frameworks, and inference/training stacks to ensure state-of-the-art LLM workloads run efficiently and reliably at scale. You will lead deep performance and reliability investigations on multi-GPU and multi-node deployments, define how new platforms are benchmarked and qualified, and build the resilience and failure-attribution capabilities essential for large clusters. This is a hands-on, senior individual-contributor role for an engineer experienced at the intersection of deep learning systems, GPU performance, distributed computing, and large-scale operations.

$184k - $357k

US, CA, Santa Clara remote
PythonLLMPyTorch +15 more

Software Engineering Manager - GPU Communications Libraries

1d ago
n

nvidia

We are the GPU Communications Libraries and Networking team at NVIDIA, responsible for delivering critical communication libraries like NCCL, NVSHMEM, and UCX for Deep Learning and High-Performance Computing (HPC) applications. These applications demand immense compute power and operate at scales involving tens of thousands of GPUs, connected via high-speed interconnects and networking. Communication performance is paramount, directly impacting end-to-end application performance, especially at massive scales. We are seeking a technical leader to manage our NVSHMEM and UCX libraries, offering an exceptional opportunity to advance the state-of-the-art and develop groundbreaking platforms.

$184k - $357k

US, CA, Santa Clara remote
PyTorchTensorFlowDeep Learning +10 more

Senior Software Architect - Deep Learning and HPC Communications

1d ago
n

nvidia

NVIDIA is seeking a Senior Software Architect to join our GPU Communications Libraries and Networking team. This role involves co-designing next-generation data center platforms and scalable communication software crucial for advancing Deep Learning and High Performance Computing (HPC). You will investigate and identify communication performance bottlenecks, design and implement new communication technologies, and explore innovative hardware and software solutions for future platforms. This is an opportunity to break performance barriers and deliver cutting-edge technologies that power AI and HPC workloads at massive scales.

$184k - $357k

US, CA, Santa Clara remote
PyTorchTensorFlowDeep Learning +8 more

Senior Deep Learning Framework Communications Engineer

1d ago
n

nvidia

NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, and SGLang. You will work with the team that created communication libraries like NCCL and NVSHMEM, and technology like GPUDirect, to scale Deep Learning and HPC applications. Your work will directly impact AI application performance by improving communication between GPUs, making AI toolkits easier for the community to use. This role offers an outstanding opportunity for someone with an AI background to advance the state of the art in this space.

$184k - $357k

US, CA, Santa Clara remote
PythonPyTorchReinforcement Learning +9 more

Senior Software Engineer, NCCL

1d ago
n

nvidia

NVIDIA is seeking a highly motivated senior software engineer to join its communication libraries and network software team. This role involves developing and maintaining software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning. You will be instrumental in designing and implementing highly-optimized communication runtimes and system software that enables interactions among GPUs and with other system components, contributing to the advancement of AI and HPC.

$152k - $288k

US, CA, Santa Clara remote
PyTorchTensorFlowDeep Learning +8 more

Senior System Software Engineer - GPU Performance

1d ago
n

nvidia

NVIDIA is seeking a motivated Performance Engineer to join our GPU Communications Libraries and Networking team. This role involves influencing the roadmap of communication libraries that are critical for Deep Learning and High Performance Computing applications running on massive GPU clusters. You will analyze and optimize communication performance between GPUs, which directly impacts end-to-end application performance at scale. This is an excellent opportunity to advance the state of the art in GPU communication and contribute to NVIDIA's innovative technologies.

$152k - $288k

US, CA, Santa Clara remote
DockerKubernetesPython +10 more

Senior Deep Learning Frameworks CUDA Software Engineer

1d ago
n

nvidia

NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced CUDA features and Distributed Runtime technologies into AI stacks, including frameworks like PyTorch, TRT-LLM, vLLM, SGLang, and JAX. You will join the team responsible for core CUDA features and runtimes that scale Deep Learning and HPC applications, addressing diverse multi-GPU demands from large-scale training to low-latency inference. Your work will enhance the productivity and performance of AI applications, accelerating community adoption through AI toolkits. This role offers a significant opportunity to advance the state of the art in AI technologies.

$184k - $357k

US, CA, Santa Clara remote
PythonPyTorchReinforcement Learning +11 more

Senior Software Engineer, AI Networking

1d ago
n

nvidia

NVIDIA is seeking an outstanding Software Engineer to join its US-based networking software team. As a technical leader, you will drive the transformation of AI networking systems, applying deep expertise to manage complex customer engagements and influence product and architecture direction. This role offers a significant opportunity to impact NVIDIA's networking technologies and the broader industry, working in a diverse and supportive environment where innovation is encouraged.

$184k - $357k

US, WA, Seattle remote
AICUDADistributed Systems +7 more

Principal Developer, AI Networking

1d ago
n

nvidia

NVIDIA is seeking a senior software engineer for its AI Networking Codesign and Benchmarking R&D group. In this role, you will be responsible for profiling, analyzing, and optimizing AI workloads on large-scale GPU and CPU clusters, focusing on distributed Deep Learning LLM training and inference. Your work will center on collective communication and networking, involving collaboration across hardware components like HCAs, Switches, CPUs, and GPUs, as well as software layers including LLM applications, machine learning frameworks, and communication libraries. You will also develop performance analysis tools and strategies to identify and clarify performance expectations, limitations, and bottlenecks, contributing directly to AI innovation.

$272k - $489k

US, CA, Santa Clara remote
PythonLLMPyTorch +7 more

Principal Architect, AI Networking

1d ago
n

nvidia

An applied research team within NVIDIA's Networking Systems & Software Architecture group is tackling complex AI infrastructure challenges. The team develops systems-level software to optimize data movement between GPUs, nodes, and storage at the speed required for modern AI, focusing on low-level transport, hardware-software co-design, and communication frameworks integrated into AI stacks. Their work also extends to emerging areas like quantum computing interconnects. This Principal Architect role will define the research agenda and architectural direction for NVIDIA's large-scale AI systems communication, encompassing GPUs, DPUs, NICs, and heterogeneous storage. The position demands the ability to define project scope, conduct original research, publish findings, and translate breakthroughs into production-ready software for industry-wide deployment.

$272k - $431k

US, CA, Santa Clara remote
PythonRustDistributed Training +10 more

Principal Deep Learning Communication Architect

1d ago
n

nvidia

NVIDIA is seeking a Principal Deep Learning Communication Architect to define the long-term technical roadmap for communication libraries across next-generation platforms, ensuring seamless scaling of models to massive clusters. This role involves leading the development of advanced communication primitives and collective algorithms, optimizing for heterogeneous interconnects, and co-designing libraries with application developers to meet the demands of trillion-parameter and Agentic AI. The architect will also collaborate with silicon architects to influence hardware specifications for future networking needs and develop analytical models to predict system behavior under emerging workloads.

$272k - $431k

US, CA, Santa Clara remote
PyTorchDeep LearningJAX +9 more

Software Engineer, ML Performance

2d ago
n

nvidia

NVIDIA is seeking a dedicated Software Engineer, ML Performance to join our team in Santa Clara, CA. In this role, you will engage directly with the latest AI technologies and work on optimizing performance at an outstanding scale. Your expertise will ensure that our groundbreaking solutions operate flawlessly and continue to lead the industry. You will be immersed in an inclusive, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

$224k - $357k

US, CA, Santa Clara onsite
PythonPyTorchJAX +7 more

Helix AI Engineer, Training Performance

2d ago
F

Figure AI

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping human-level intelligence. The Helix team is seeking an experienced AI Training Performance Engineer to elevate model training. This role focuses on enhancing distributed training frameworks for large-scale model training, optimizing GPU kernels, evaluating different accelerator types, and co-designing models for maximum hardware utilization.

$200k - $400k

San Jose, CA onsite
PythonPyTorchJAX +9 more

DSX NVCRE Senior Engineer

3d ago
n

nvidia

NVIDIA is seeking a Senior Software Engineer to join our DSX team. You will build and operate tooling that verifies AI infrastructure readiness for production, focusing on cluster readiness and certification software. This includes working with the open-source Cluster Readiness Engine to validate GPU clusters across Kubernetes and Slurm, measure training and inference performance, and produce trustworthy evidence for customers and partners. You will collaborate with leading AI companies and cloud providers to ensure their infrastructure performs as designed for critical workloads.

$184k - $357k

US, CA, Santa Clara remote
KubernetesPythonGo +9 more

Forward Deployed Engineer, Physical AI Infrastructure

4d ago
N

Nebius

Nebius is building a full-stack AI cloud platform for the global AI economy, supporting developers and enterprises from data and model training through to production deployment. As a Forward Deployed Engineer, you will work directly with Physical AI customers to understand their workloads and production requirements. Your insights will shape our core infrastructure products and inform future development by connecting needs across Physical AI industries with product decisions. You will also investigate opportunities for new Nebius products by developing hypotheses about unmet needs, examining demand, and building prototypes to test with customers. This hands-on role involves writing code, deploying and benchmarking models, building agents, and troubleshooting infrastructure alongside customer engineers, with close collaboration across customers, NVIDIA, Product, and Engineering.

$180k - $224k

Remote - United States onsite
KubernetesPythonGo +12 more

Sr. Solutions Engineer (GPU Infrastructure)

4d ago
N

Nebius

Nebius is seeking a Sr. Solutions Engineer to serve as the primary technical partner for customers deploying and operating GPU clusters and AI infrastructure on the Nebius platform. This role involves bridging customer requirements with internal engineering capabilities to ensure successful deployment, stable operations, and ongoing optimization of complex, high-performance environments. You will be instrumental in supporting customers, investigating and resolving complex issues, and contributing to the continuous improvement of our systems.

$180k - $220k

Remote - United States remote
LinuxNCCLAI infrastructure +4 more

Senior AI Infrastructure Systems Engineer (R&D / GPU / AI)

4d ago
N

Nebius

Nebius is building a full-stack AI cloud platform to support developers and enterprises in AI/ML infrastructure. This senior systems engineering role focuses on diagnosing and resolving complex hardware and platform failures in high-performance AI infrastructure. The engineer will work across Linux, GPU servers, PCIe, firmware, power, and cooling to determine the root cause of issues, developing new troubleshooting procedures for ambiguous problems. The role requires strong ownership, curiosity, and the ability to turn ambiguous problems into evidence-based conclusions.

$180k - $224k

United States remote
PythonGoGPU +7 more

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.