Member of Technical Staff - GPU Performance Engineer
Remote • San Francisco • FullTime
Posted 1y ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Machine Learning Engineer
About the job
Liquid AI, a rapidly scaling company spun out of MIT CSAIL, is developing general-purpose AI systems designed for efficient deployment across various hardware, from data centers to edge devices. We focus on delivering low latency, minimal memory usage, privacy, and reliability for enterprise clients in sectors like consumer electronics, automotive, life sciences, and financial services. We are seeking exceptional individuals to join our small, fast-moving, high-ownership team to tackle complex performance challenges that generic frameworks cannot address.
Responsibilities
- Design and ship custom CUDA kernels.
- Profile GPU performance at the hardware level.
- Integrate research ideas into production code for measurable speedups.
- Write high-performance GPU kernels for novel model architectures.
- Integrate kernels into PyTorch pipelines, including custom ops, extensions, dispatch, and benchmarking.
- Profile and optimize training and inference workflows to eliminate bottlenecks.
- Build correctness tests and numerics checks.
- Build and maintain performance benchmarks and guardrails to prevent regressions.
- Collaborate with researchers to implement promising ideas as production speedups.
Requirements
- Experience authoring custom CUDA kernels (beyond cuDNN/cuBLAS).
- Strong understanding of GPU architecture and performance (memory hierarchy, warps, shared memory/register pressure, bandwidth vs. compute limits).
- Proficiency with low-level profiling tools (Nsight Systems/Compute) and performance methodology.
- Strong C/C++ skills.
- Experience with CUTLASS and tensor core utilization strategies is desired.
- Experience with Triton kernels and/or PyTorch custom op integration is desired.
- Experience building benchmark harnesses and performance regression tests is desired.
Benefits
- Competitive base salary with equity.
- 100% coverage of medical, dental, and vision premiums for employees and dependents.
- 401(k) matching up to 4% of base pay.
- Unlimited PTO plus company-wide Refill Days.