Senior Software Engineer, NCCL
$152k - $288k • US, CA, Santa Clara
Posted 3d ago
About the job
NVIDIA is seeking a highly motivated senior software engineer to join its communication libraries and network software team. This role involves developing and maintaining software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning. You will be instrumental in designing and implementing highly-optimized communication runtimes and system software that enables interactions among GPUs and with other system components, contributing to the advancement of AI and HPC.
Responsibilities
- Design, implement, and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g., NCCL for TensorFlow/PyTorch) and HPC programming interfaces (e.g., UCX for MPI/OpenSHMEM) on GPU clusters.
- Participate in and contribute to parallel programming interface specifications like MPI/OpenSHMEM.
- Design, implement, and maintain system software enabling GPU-to-GPU and GPU-to-other component interactions.
- Create proof-of-concepts to evaluate and motivate extensions in programming models, runtime designs, and hardware features.
Requirements
- M.S./Ph.D. degree in CS/CE or equivalent experience.
- 5+ years of relevant experience.
- Excellent C/C++ programming and debugging skills.
- Strong experience with Linux.
- Expert understanding of computer system architecture and operating systems.
- Experience with parallel programming interfaces and communication runtimes.
- Ability to work and communicate effectively in a multi-national, multi-time-zone corporate environment.
Benefits
- Highly competitive salaries
- Comprehensive benefits package
- Equity
- Eligibility for benefits