Senior High-Performance LLM Training Engineer
$184k - $357k • US, CA, Santa Clara
Posted 1d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
On-site
Categories
LLM Engineer
About the job
NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads. This role focuses on optimizing NVIDIA’s high-performance LLM software stack in frameworks like PyTorch and JAX for high-performance training on thousands of GPUs. You will also help shape hardware roadmaps for the next generation of GPUs powering the AI revolution. This is an opportunity to collaborate with forward-thinking individuals and shape the future of AI in a creative and autonomous work environment.
Responsibilities
- Analyze, profile, and optimize AI training workloads on innovative hardware and software platforms.
- Understand and solve training performance problems across state-of-the-art neural networks on GPUs.
- Implement production-quality software within NVIDIA's deep learning platform stack, from drivers to DL frameworks.
- Build and support NVIDIA submissions to the MLPerf Training benchmark suite.
- Implement key DL training workloads in NVIDIA's proprietary processor and system simulators for future architecture studies.
- Develop tools to automate workload analysis, optimization, and other critical workflows.
Requirements
- PhD in Computer Science, Electrical Engineering or Computer Engineering and 5+ years of experience, or MS (or equivalent experience) and 8+ years of meaningful work experience.
- Strong background in deep learning and neural networks, particularly training.
- Deep background in computer architecture and familiarity with GPU architecture fundamentals.
- Proven experience analyzing and tuning application performance and processor/system-level performance modeling.
- Programming skills in C++, Python, and CUDA.
Benefits
- Highly competitive salaries
- Comprehensive benefits package
- Equity
- Opportunity to collaborate with forward-thinking people
- Creative and autonomous work environment that encourages innovation