Senior Deep Learning Compiler Engineer - PyTorch
€112k - €194k • Germany, Berlin • Full-time
Posted 12h ago
Remote Work Policy
On-site
Employment Type
Full-time
Categories
LLM Engineer
About the job
Join NVIDIA at the forefront of AI compiler technology and help shape the future of accelerated computing. We are building Thunder, an ambitious source-to-source compiler designed to unlock outstanding performance for PyTorch models on NVIDIA GPUs. This role offers a unique opportunity to contribute to the PyTorch ecosystem, working with modern compiler stacks like PyTorch 2.0's TorchDynamo and TorchInductor to create powerful, open-source solutions. If you are driven to solve complex problems and want to make a foundational impact on the AI ecosystem, apply to join our collaborative and innovative team.
Responsibilities
- Lead the design, implementation, optimization, and maintenance of core compiler technologies for deep learning workloads.
- Conduct deep performance analysis on large-scale GPU workloads to identify optimization opportunities.
- Collaborate with engineers on PyTorch for NVIDIA hardware and other compiler/library teams (e.g., nvFuser, TVM, XLA, CUDA).
- Translate the latest research into practical, high-impact solutions for the open-source community.
Requirements
- Bachelor's, Master's, or Ph.D. in Computer Science or a related technical field (or equivalent experience).
- 8+ years of relevant work experience.
- Strong command of Python and experience building complex, well-tested software systems.
- Hands-on experience with deep learning frameworks like PyTorch or JAX, understanding model building and performance challenges.
- Solid foundation in compiler concepts including abstract syntax trees (ASTs), intermediate representations (e.g., SSA form), program analysis, and code generation.
- Excellent communication and collaboration skills for distributed, open-source environments.
- Previous contributions to deep learning compiler projects (e.g., TVM, MLIR, IREE) or deep learning frameworks.
- Deep expertise in PyTorch internals, particularly its compiler stack (TorchDynamo, TorchInductor).
- Experience with JAX-like functional transformations in a compiler context.
- Familiarity with parallel programming, distributed systems, and high-performance CUDA code.
- Track record of impactful participation in open-source communities.
Benefits
- Highly competitive salaries
- Extensive benefits package