Senior AI Training Performance Architect
$184k - $357k • US, CA, Santa Clara
Posted 1d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
On-site
Categories
Machine Learning Engineer
About the job
NVIDIA is seeking a senior engineer obsessed with performance analysis and optimization to help squeeze every last clock cycle out of AI training, the workload driving the design and construction of the largest and most powerful compute systems in the world. This role offers the opportunity to directly impact the hardware and software roadmap in a fast-growing technology company that leads the AI revolution. Join us and help design and build the world's most powerful compute systems!
Responsibilities
- Understand, analyze, profile, and optimize AI training workloads on state-of-the-art hardware and software platforms.
- Identify performance bottlenecks of AI training on GPUs, prioritize and solve problems across key AI training workloads.
- Implement production-quality software across multiple layers of NVIDIA's deep learning platform stack, from drivers to DL frameworks.
- Build and support NVIDIA submissions for MLPerf Training benchmarks.
- Implement key DL training workloads in NVIDIA's proprietary processor and system simulators for future architecture studies.
- Develop tools to automate workload analysis, optimization, and other critical workflows.
Requirements
- PhD in CS, EE or CSEE (or equivalent experience) with 5+ years of relevant experience; or MS with 8+ years of experience.
- Strong background in deep learning and neural networks, particularly in training.
- Solid understanding of computer architecture and familiarity with GPU architecture fundamentals.
- Proven background in analyzing and tuning application performance.
- Proven experience with processor and system-level performance modeling.
- Proficiency in programming with C++, Python, and CUDA.
Benefits
- Equity
- Benefits