High-Performance LLM Training Engineer - New College Grad 2027
$124k - $242k • US, CA, Santa Clara
Posted 1d ago
About the job
NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads. This position focuses on optimizing NVIDIA's high-performance LLM software stack in frameworks like PyTorch and JAX for high-performance pre-training and post-training on thousands of GPUs. You will also help shape hardware roadmaps for the next generation of GPUs powering the AI revolution.
Responsibilities
- Understand, analyze, profile, and optimize AI training workloads on innovative hardware and software platforms.
- Understand and solve problems across state-of-the-art LLMs related to training performance on GPUs.
- Implement production-quality software in NVIDIA's deep learning platform stack.
- Implement key LLM training workloads in NVIDIA's proprietary processor and system simulators for future architecture studies.
- Build agentic tools to automate workload analysis, optimization, and other critical workflows.
Requirements
- M.S. or PhD in Computer Science, Electrical Engineering or Computer Engineering (or equivalent experience).
- Strong background in deep learning and neural networks, particularly model training optimizations.
- Deep background in computer architecture and familiarity with GPU architecture fundamentals.
- Proven experience analyzing and tuning application performance and processor/system-level performance modeling.
- Programming skills in C++, Python, and CUDA.
Benefits
- Highly competitive salaries
- Comprehensive benefits package
- Equity