Senior Software Engineer, CUTLASS Performance
$152k - $288k • US, CA, Santa Clara
Posted 1d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
On-site
Categories
Machine Learning Engineer
About the job
NVIDIA's CUTLASS is a popular open-source ecosystem for high-performance linear algebra and Tensor Core primitives, providing C++ and Python abstractions for computations on NVIDIA GPUs. This role focuses on bridging the gap between current and theoretical performance, optimizing GPU kernels and fusion opportunities within deep learning models. You will develop tooling for automated benchmarking and analysis, becoming an authoritative resource on kernel performance and collaborating with various NVIDIA teams.
Responsibilities
- Benchmark performance of deep learning models' inference and training to identify GPU kernel and fusion opportunities.
- Identify performance gaps and suggest software improvements or model adjustments.
- Develop tooling to automate benchmarking, analysis, and performance optimization.
- Serve as the team's expert on kernel performance and liaise with GPU architecture, DL frameworks, and QA teams.
Requirements
- Master's or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
- 3+ years of relevant industry experience.
- Strong programming skills in Python and C++.
- Experience in software performance analysis and optimization.
- Deep understanding of computer architecture and familiarity with GPUs or similar parallel processing architectures.
Benefits
- Equity
- Benefits
- Salary range: 152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.