NCCL Jobs
36 open roles mentioning NCCL
Principal Engineer - Perf and Benchmarking
CoreWeave
CoreWeave is seeking a Principal Engineer to lead its Benchmarking & Performance team. This role will be responsible for a global performance data warehouse, ingesting, storing, transforming, and analyzing performance events across all data centers. You will also play a key part in industry-leading performance benchmarking publications, working closely with NVIDIA and the open-source community to demonstrate CoreWeave's performance and reliability leadership in AI.
$206k - $333k
Senior Software Engineer - Perf and Benchmarking
CoreWeave
CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team. This role will be instrumental in managing a planet-scale performance data warehouse, handling the ingestion, storage, transformation, and analysis of performance events across global data centers. The engineer will also contribute to industry-leading performance benchmarking publications like MLPerf. The position involves owning designs, elevating engineering standards, and driving measurable improvements in latency, throughput, and reliability across multiple services. Collaboration with product, orchestration, and hardware teams will be key to evolving the Kubernetes-native platform and meeting stringent P99 SLAs at scale.
$182k - $242k
Senior Deep Learning Software Engineer, Inference
nvidia
NVIDIA is seeking a Senior Software Engineer to specialize in Deep Learning Inference. This role involves designing, building, and optimizing GPU-accelerated software for AI applications, focusing on high-performance deep learning frameworks like SGLang and vLLM for efficient large-scale model serving and inference. You will contribute to improving these platforms, enabling the smooth deployment of advanced language models and working with the deep learning community to implement and release the latest algorithms. The work will concentrate on enhancing the performance of state-of-the-art LLM and Generative AI models across various NVIDIA accelerators, utilizing open-source tools and kernels for optimization.
$184k - $357k
Senior Software Engineer, DGX Cloud AI Infrastructure
nvidia
NVIDIA is seeking a Senior Software Engineer to lead the bring-up, triage, benchmarking, analysis, and optimization of distributed training and inference workloads across NVIDIA GPU platforms at the largest scales. In this role, you will set technical direction for communication libraries, model frameworks, and inference/training stacks to ensure state-of-the-art LLM workloads run efficiently and reliably at scale. You will lead deep performance and reliability investigations on multi-GPU and multi-node deployments, define how new platforms are benchmarked and qualified, and build the resilience and failure-attribution capabilities essential for large clusters. This is a hands-on, senior individual-contributor role for an engineer experienced at the intersection of deep learning systems, GPU performance, distributed computing, and large-scale operations.
$184k - $357k
Software Engineering Manager - GPU Communications Libraries
nvidia
We are the GPU Communications Libraries and Networking team at NVIDIA, responsible for delivering critical communication libraries like NCCL, NVSHMEM, and UCX for Deep Learning and High-Performance Computing (HPC) applications. These applications demand immense compute power and operate at scales involving tens of thousands of GPUs, connected via high-speed interconnects and networking. Communication performance is paramount, directly impacting end-to-end application performance, especially at massive scales. We are seeking a technical leader to manage our NVSHMEM and UCX libraries, offering an exceptional opportunity to advance the state-of-the-art and develop groundbreaking platforms.
$184k - $357k
Senior Software Architect - Deep Learning and HPC Communications
nvidia
NVIDIA is seeking a Senior Software Architect to join our GPU Communications Libraries and Networking team. This role involves co-designing next-generation data center platforms and scalable communication software crucial for advancing Deep Learning and High Performance Computing (HPC). You will investigate and identify communication performance bottlenecks, design and implement new communication technologies, and explore innovative hardware and software solutions for future platforms. This is an opportunity to break performance barriers and deliver cutting-edge technologies that power AI and HPC workloads at massive scales.
$184k - $357k
Senior Deep Learning Framework Communications Engineer
nvidia
NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, and SGLang. You will work with the team that created communication libraries like NCCL and NVSHMEM, and technology like GPUDirect, to scale Deep Learning and HPC applications. Your work will directly impact AI application performance by improving communication between GPUs, making AI toolkits easier for the community to use. This role offers an outstanding opportunity for someone with an AI background to advance the state of the art in this space.
$184k - $357k
Senior Software Engineer, NCCL
nvidia
NVIDIA is seeking a highly motivated senior software engineer to join its communication libraries and network software team. This role involves developing and maintaining software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning. You will be instrumental in designing and implementing highly-optimized communication runtimes and system software that enables interactions among GPUs and with other system components, contributing to the advancement of AI and HPC.
$152k - $288k
Senior System Software Engineer - GPU Performance
nvidia
NVIDIA is seeking a motivated Performance Engineer to join our GPU Communications Libraries and Networking team. This role involves influencing the roadmap of communication libraries that are critical for Deep Learning and High Performance Computing applications running on massive GPU clusters. You will analyze and optimize communication performance between GPUs, which directly impacts end-to-end application performance at scale. This is an excellent opportunity to advance the state of the art in GPU communication and contribute to NVIDIA's innovative technologies.
$152k - $288k
Senior Deep Learning Frameworks CUDA Software Engineer
nvidia
NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced CUDA features and Distributed Runtime technologies into AI stacks, including frameworks like PyTorch, TRT-LLM, vLLM, SGLang, and JAX. You will join the team responsible for core CUDA features and runtimes that scale Deep Learning and HPC applications, addressing diverse multi-GPU demands from large-scale training to low-latency inference. Your work will enhance the productivity and performance of AI applications, accelerating community adoption through AI toolkits. This role offers a significant opportunity to advance the state of the art in AI technologies.
$184k - $357k
Senior Software Engineer, AI Networking
nvidia
NVIDIA is seeking an outstanding Software Engineer to join its US-based networking software team. As a technical leader, you will drive the transformation of AI networking systems, applying deep expertise to manage complex customer engagements and influence product and architecture direction. This role offers a significant opportunity to impact NVIDIA's networking technologies and the broader industry, working in a diverse and supportive environment where innovation is encouraged.
$184k - $357k
Principal Developer, AI Networking
nvidia
NVIDIA is seeking a senior software engineer for its AI Networking Codesign and Benchmarking R&D group. In this role, you will be responsible for profiling, analyzing, and optimizing AI workloads on large-scale GPU and CPU clusters, focusing on distributed Deep Learning LLM training and inference. Your work will center on collective communication and networking, involving collaboration across hardware components like HCAs, Switches, CPUs, and GPUs, as well as software layers including LLM applications, machine learning frameworks, and communication libraries. You will also develop performance analysis tools and strategies to identify and clarify performance expectations, limitations, and bottlenecks, contributing directly to AI innovation.
$272k - $489k
Principal Architect, AI Networking
nvidia
An applied research team within NVIDIA's Networking Systems & Software Architecture group is tackling complex AI infrastructure challenges. The team develops systems-level software to optimize data movement between GPUs, nodes, and storage at the speed required for modern AI, focusing on low-level transport, hardware-software co-design, and communication frameworks integrated into AI stacks. Their work also extends to emerging areas like quantum computing interconnects. This Principal Architect role will define the research agenda and architectural direction for NVIDIA's large-scale AI systems communication, encompassing GPUs, DPUs, NICs, and heterogeneous storage. The position demands the ability to define project scope, conduct original research, publish findings, and translate breakthroughs into production-ready software for industry-wide deployment.
$272k - $431k
Principal Deep Learning Communication Architect
nvidia
NVIDIA is seeking a Principal Deep Learning Communication Architect to define the long-term technical roadmap for communication libraries across next-generation platforms, ensuring seamless scaling of models to massive clusters. This role involves leading the development of advanced communication primitives and collective algorithms, optimizing for heterogeneous interconnects, and co-designing libraries with application developers to meet the demands of trillion-parameter and Agentic AI. The architect will also collaborate with silicon architects to influence hardware specifications for future networking needs and develop analytical models to predict system behavior under emerging workloads.
$272k - $431k
Software Engineer, ML Performance
nvidia
NVIDIA is seeking a dedicated Software Engineer, ML Performance to join our team in Santa Clara, CA. In this role, you will engage directly with the latest AI technologies and work on optimizing performance at an outstanding scale. Your expertise will ensure that our groundbreaking solutions operate flawlessly and continue to lead the industry. You will be immersed in an inclusive, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.
$224k - $357k
Helix AI Engineer, Training Performance
Figure AI
Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping human-level intelligence. The Helix team is seeking an experienced AI Training Performance Engineer to elevate model training. This role focuses on enhancing distributed training frameworks for large-scale model training, optimizing GPU kernels, evaluating different accelerator types, and co-designing models for maximum hardware utilization.
$200k - $400k
DSX NVCRE Senior Engineer
nvidia
NVIDIA is seeking a Senior Software Engineer to join our DSX team. You will build and operate tooling that verifies AI infrastructure readiness for production, focusing on cluster readiness and certification software. This includes working with the open-source Cluster Readiness Engine to validate GPU clusters across Kubernetes and Slurm, measure training and inference performance, and produce trustworthy evidence for customers and partners. You will collaborate with leading AI companies and cloud providers to ensure their infrastructure performs as designed for critical workloads.
$184k - $357k
Forward Deployed Engineer, Physical AI Infrastructure
Nebius
Nebius is building a full-stack AI cloud platform for the global AI economy, supporting developers and enterprises from data and model training through to production deployment. As a Forward Deployed Engineer, you will work directly with Physical AI customers to understand their workloads and production requirements. Your insights will shape our core infrastructure products and inform future development by connecting needs across Physical AI industries with product decisions. You will also investigate opportunities for new Nebius products by developing hypotheses about unmet needs, examining demand, and building prototypes to test with customers. This hands-on role involves writing code, deploying and benchmarking models, building agents, and troubleshooting infrastructure alongside customer engineers, with close collaboration across customers, NVIDIA, Product, and Engineering.
$180k - $224k
Sr. Solutions Engineer (GPU Infrastructure)
Nebius
Nebius is seeking a Sr. Solutions Engineer to serve as the primary technical partner for customers deploying and operating GPU clusters and AI infrastructure on the Nebius platform. This role involves bridging customer requirements with internal engineering capabilities to ensure successful deployment, stable operations, and ongoing optimization of complex, high-performance environments. You will be instrumental in supporting customers, investigating and resolving complex issues, and contributing to the continuous improvement of our systems.
$180k - $220k
Senior AI Infrastructure Systems Engineer (R&D / GPU / AI)
Nebius
Nebius is building a full-stack AI cloud platform to support developers and enterprises in AI/ML infrastructure. This senior systems engineering role focuses on diagnosing and resolving complex hardware and platform failures in high-performance AI infrastructure. The engineer will work across Linux, GPU servers, PCIe, firmware, power, and cooling to determine the root cause of issues, developing new troubleshooting procedures for ambiguous problems. The role requires strong ownership, curiosity, and the ability to turn ambiguous problems into evidence-based conclusions.
$180k - $224k
