DSX NVCRE Senior Engineer
$184k - $357k • Remote • US, CA, Santa Clara
Posted 1d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
NVIDIA is seeking a Senior Software Engineer to join our DSX team. You will build and operate tooling that verifies AI infrastructure readiness for production, focusing on cluster readiness and certification software. This includes working with the open-source Cluster Readiness Engine to validate GPU clusters across Kubernetes and Slurm, measure training and inference performance, and produce trustworthy evidence for customers and partners. You will collaborate with leading AI companies and cloud providers to ensure their infrastructure performs as designed for critical workloads.
Responsibilities
- Design and build systems to automate cluster validation into repeatable, verifiable software.
- Design and implement cluster readiness and certification tooling in Go and Python for Kubernetes and Slurm environments.
- Develop a catalog of benchmarks and real workloads covering communication, compute, storage, diagnostics, training, inference, reliability, and security.
- Develop provenance and evidence pipelines to capture execution details and produce signed, auditable results.
- Integrate new GPU platforms, schedulers, and fabrics into the testing framework.
- Collaborate with internal teams and cloud partners to resolve performance and correctness issues.
- Contribute to the open-source Cluster Readiness Engine and related projects.
- Author design documents, runbooks, and operational guides for cluster validation.
Requirements
- BS, MS, or Ph.D. in Computer Science, Computer/Electrical Engineering, or equivalent experience.
- 8+ years of software engineering experience in infrastructure or systems software, preferably for large-scale compute, cloud, or HPC environments.
- Strong programming skills in Go and Python, with experience shipping production-quality services or tools.
- Deep familiarity with Linux systems, containers, and Kubernetes, including writing operators or controllers.
- Working knowledge of HPC schedulers like Slurm and GPU cluster fundamentals (drivers, NCCL, InfiniBand/RoCE, GPU health tooling).
- Experience benchmarking or validating distributed systems with a rigorous approach to measurement and reproducibility.
- Demonstrated ability to lead complex technical investigations and communicate findings clearly.
Benefits
- Equity
- Benefits