Research Scientist / Engineer – Performance Optimization
$195k - $395k • Remote • Redwood City, CA • FullTime
Posted 9d ago
Job Location
Redwood City, CA
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Machine Learning Engineer
About the job
Luma is seeking a Research Scientist/Engineer to focus on optimizing the performance of their multimodal models. This role involves profiling and enhancing GPU, CPU, and accelerator code to ensure efficient training and scalable deployment without compromising quality. You will be responsible for writing kernels and operations that maximize hardware utilization and minimize latency, requiring deep expertise in GPU optimization, transformer internals, and low-level programming.
Responsibilities
- Profile and optimize GPU/CPU/accelerator code for maximum utilization and minimal latency.
- Write high-performance PyTorch, Triton, and CUDA code, developing custom operations as needed.
- Develop fused kernels and leverage tensor cores and modern hardware features.
- Optimize model architectures and implementations for distributed multi-node production deployment.
- Build performance monitoring and analysis tools and automation.
- Research and implement cutting-edge optimization techniques for transformer models.
Requirements
- Expert-level Triton/CUDA programming and GPU optimization skills.
- Strong PyTorch skills, including kernel development and custom operations.
- Proficiency with profiling tools such as NVIDIA Nsight, torch profiler, and custom tooling.
- Deep understanding of transformer architectures and attention mechanisms.