Senior Deep Learning Compiler Engineer - HW-SW Codesign
$152k - $288k • Remote • US, CA, Santa Clara
Posted 1mo ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
Machine Learning Engineer
About the job
NVIDIA is seeking versatile software engineers for its XLA team to build high-performance, production-grade software at the core of next-generation AI systems. This role involves developing compiler optimization algorithms for deep learning workloads, optimizing inference and training performance for the JAX framework and the OpenXLA compiler on NVIDIA GPUs at scale. You will collaborate with deep learning framework and hardware architecture teams to accelerate future AI software.
Responsibilities
- Develop compiler optimization algorithms for deep learning workloads.
- Optimize inference and training performance for JAX and OpenXLA on NVIDIA GPUs.
- Craft and implement compiler optimization techniques for deep learning network graphs.
- Design novel graph partitioning and tensor sharding techniques for distributed training and inference.
- Perform performance tuning and analysis.
- Generate code for NVIDIA GPU backends using open-source compilers like MLIR, LLVM, and OpenAI Triton.
- Design user-facing features in JAX and related libraries.
- Collaborate with GPU hardware engineering teams on AI compiler software features for next-generation GPUs.
Requirements
- Bachelor's, Master's, or Ph.D. in Computer Science, Computer Engineering, or a related field (or equivalent experience).
- 4+ years of relevant work or research experience in performance analysis and compiler optimizations.
- Ability to work independently, define project goals and scope, and lead development efforts with clean software engineering and testing practices.
- Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
- Strong foundation in CPU, GPU, or other high-performance hardware accelerator architecture.
- Knowledge of high-performance computing and distributed programming.
- Experience with XLA, TVM, MLIR, LLVM, OpenAI Triton, deep learning models/algorithms, and deep learning framework design is a plus.
- Strong interpersonal skills and ability to work in a dynamic, product-oriented team.
- Experience working with deep learning frameworks such as JAX, PyTorch, or TensorFlow is a plus.
- Extensive experience with CUDA or GPUs in general is a plus.
- Experience with open-source compilers such as XLA, LLVM, MLIR, or TVM is a plus.
Benefits
- Competitive salaries
- Generous benefits package
- Eligibility for equity