ML Runtime Optimization Engineer
$217k - $318k • Sunnyvale • FullTime
Posted 1y ago
Job Location
Sunnyvale
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Machine Learning Engineer
About the job
Applied Intuition is seeking a software engineer with deep expertise in optimizing ML models and deploying them within production-grade embedded runtime environments. This role involves working across the entire ML framework stack, including PyTorch, JAX, ONNX, TensorRT, CUDA, XLA, and Triton. You will be instrumental in driving ML performance optimization for various technologies used in ADAS/AD stacks, targeting diverse embedded compute platforms. The position requires developing strategies to enhance the efficiency and reduce the latency of model inference on customer-selected compute boards, and supporting deployment on memory-constrained platforms through model pruning and quantization.
Responsibilities
- Drive ML performance optimization on multiple technologies for ADAS/AD stacks targeting embedded compute platforms.
- Develop compute usage strategies to optimize model inference efficiency and latency.
- Work on model pruning and quantization for memory-constrained platforms.
- Collaborate with ML engineers and software developers to optimize model architecture solutions.
- Set up methodologies to profile model performance on target embedded compute platforms and identify bottlenecks.
Requirements
- Bachelors in Electrical Engineering or Computer Science, OR B.Sc. in Computer Science, Mathematics, Physics or a related field.
- 3+ years of experience with ML accelerators, GPU, CPU, SoC architecture and micro-architecture.
- Strong software development skills with a focus on embedded programming.
- Experience profiling and optimizing model performance on embedded compute platforms.
- Experience with deep learning frameworks such as PyTorch, JAX, ONNX.
Benefits
- Base salary
- Equity (options and/or restricted stock units)
- Comprehensive health, dental, vision, life and disability insurance coverage
- 401k retirement benefits with employer match
- Learning and wellness stipends
- Paid time off