Senior Software Architect - Deep Learning and HPC Communications
$184k - $357k • Remote • US, CA, Santa Clara
Posted 6d ago
About the job
NVIDIA is seeking a Senior Software Architect to join our GPU Communications Libraries and Networking team. This role involves co-designing next-generation data center platforms and scalable communication software crucial for advancing Deep Learning and High Performance Computing (HPC). You will investigate and identify communication performance bottlenecks, design and implement new communication technologies, and explore innovative hardware and software solutions for future platforms. This is an opportunity to break performance barriers and deliver cutting-edge technologies that power AI and HPC workloads at massive scales.
Responsibilities
- Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems.
- Design and implement new communication technologies to accelerate AI and HPC workloads.
- Explore innovative solutions in hardware and software for next-generation platforms as part of co-design efforts.
- Build proofs-of-concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations.
- Use simulation to explore performance of large GPU clusters.
Requirements
- M.S./Ph.D. degree in CS/CE or equivalent experience.
- 5+ years of relevant experience.
- Excellent C/C++ programming and debugging skills.
- Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).
- Deep understanding of operating systems, computer and system architecture.
- Solid understanding of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.
- Strong experience with Linux.
Benefits
- Equity
- Benefits