Principal AI and ML Infra Software Engineer, GPU Clusters
$272k - $431k • Remote • US, CA, Santa Clara
Posted 5d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
NVIDIA is seeking a Principal AI and ML Infra Software Engineer to join their Hardware Infrastructure team. This role is pivotal in enhancing researcher efficiency by implementing advancements across the entire technology stack. The engineer will collaborate closely with customers to identify and resolve infrastructure deficiencies, enabling groundbreaking AI and ML research on GPU Clusters. The goal is to build powerful, effective, and scalable solutions that shape the future of AI/ML technology.
Responsibilities
- Collaborate with AI and ML research teams to understand infrastructure needs and challenges, translating them into actionable improvements.
- Proactively identify and lead initiatives to improve researcher efficiency bottlenecks.
- Monitor and optimize infrastructure performance for high availability, scalability, and efficient resource utilization.
- Define and refine key metrics for AI researcher efficiency.
- Work with researchers, data engineers, and DevOps professionals to develop a cohesive AI/ML infrastructure ecosystem.
- Stay updated on and advocate for the integration of new AI/ML technologies, frameworks, and strategies.
Requirements
- BS or equivalent experience in Computer Science or a related field.
- 15+ years of experience in AI/ML and HPC tasks and systems.
- Hands-on experience with HPC infrastructure, including accelerated computing (GPU, custom silicon), storage (Lustre, GPFS, BeeGFS), scheduling & orchestration (Slurm, Kubernetes, LSF), high-speed networking (Infiniband, RoCE, Amazon EFA), and container technologies (Docker, Enroot).
- Experience supervising and improving distributed training operations using PyTorch (DDP, FSDP), NeMo, or JAX.
- In-depth understanding of AI/ML workflows, including data processing, model training, and inference pipelines.
- Proficiency in programming and scripting languages such as Python, Go, and Bash.
- Familiarity with cloud computing platforms (AWS, GCP, Azure).
- Experience with parallel computing frameworks and paradigms.
- Excellent communication and collaboration skills.
Benefits
- Competitive salaries
- Comprehensive benefits package
- Equity