Senior GPU Performance Software Engineer, AI/ML
London, UK • Full-time
Posted 1mo ago
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
The Machine Learning (ML)-Omega team is responsible for optimizing, modeling, and evaluating GPU systems for comparative analysis and benchmarking for Google’s internal ML workloads. We strive for extracting maximum efficiency in Google’s GPU fleet, evaluating current and future ML workloads to guide decision-making for the Cloud hardware teams. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
Responsibilities
- Identify and maintain LLM training and serving benchmarks representative of Google production, industry, and the ML community.
- Use benchmarks to identify performance opportunities and drive GPU/Triton performance.
- Guide XLA releases based on performance analysis.
- Engage with product teams like DeepMind to solve ML model performance problems on GPU hardware.
- Enable LLMs to train and serve efficiently at a very large scale.
- Run architecture-level simulations on GPU designs and perform roofline analysis.
- Analyze performance and efficiency metrics to identify bottlenecks.
- Design and implement solutions for performance optimization at Google fleet-wide scale.
- Run performance benchmarks on GPU hardware using internal and external tools.
Requirements
- Bachelor’s degree or equivalent practical experience.
- 5 years of experience with software development in one or more programming languages.
- 5 years of experience with data structures and algorithms.
- 5 years of experience with machine learning algorithms and tools, artificial intelligence, deep learning, or natural language processing.
- 3 years of experience testing, maintaining, or launching software products.
- 1 year of experience with software design and architecture.
- Master's degree or PhD in Computer Science or a related technical field (preferred).
- 1 year of experience in a technical leadership role (preferred).
- Experience with hardware/compiler co-design or high-performance computing (HPC) (preferred).
- Experience in performance analysis and debugging, improving performance of single-node or multi-node (distributed) systems (preferred).
- Experience in GPU programming using CUDA or Triton kernels (or Palace/Mosaic kernels) (preferred).
- Background in Compiler optimizations or related fields (preferred).
