Principal Developer, AI Networking
$272k - $489k • Remote • US, CA, Santa Clara
Posted 1d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
LLM Engineer
About the job
NVIDIA is seeking a senior software engineer for its AI Networking Codesign and Benchmarking R&D group. In this role, you will be responsible for profiling, analyzing, and optimizing AI workloads on large-scale GPU and CPU clusters, focusing on distributed Deep Learning LLM training and inference. Your work will center on collective communication and networking, involving collaboration across hardware components like HCAs, Switches, CPUs, and GPUs, as well as software layers including LLM applications, machine learning frameworks, and communication libraries. You will also develop performance analysis tools and strategies to identify and clarify performance expectations, limitations, and bottlenecks, contributing directly to AI innovation.
Responsibilities
- Characterize AI workloads and deep learning models for large-scale LLM training and inference on NVIDIA supercomputers, with a focus on distributed systems and high-performance networking.
- Benchmark, profile, and analyze performance to identify bottlenecks and areas for optimization, emphasizing networking aspects.
- Develop PyTorch trace-based profiling, analysis, and replaying tools for benchmarking, debugging, and co-designing network systems for LLM workloads.
- Collaborate with hardware and software teams to provide performance analysis insights.
- Define performance test plans, set performance expectations for new technologies, and work to achieve performance targets.
Requirements
- B.Sc in Computer Science or Software Engineering or equivalent experience.
- 15+ years of experience with high-performance networking (RDMA, MPI, NCCL, SHARP).
- Demonstrated ability in performance evaluation techniques and approaches.
- Experience with NVIDIA GPUs and CUDA library.
- Knowledge of deep learning frameworks like TensorFlow or PyTorch.
- Expertise in networking collective communication libraries such as NCCL and protocols like RoCE and RDMA.
- Fast and self-learning capabilities with strong analytical and problem-solving skills.
- Proficiency in Python, Bash, and C++.
- Experience with container-based development environments.
- Strong communication and teamwork skills.
Benefits
- Competitive salaries
- Generous benefits package
- Eligibility for equity
- Eligibility for benefits