Senior AI Performance Engineer
$180k - $255k • San Jose, California, United States
Posted 17d ago
Job Location
San Jose, California, United States
Tech Stack
Remote Work Policy
On-site
Categories
AI Engineer
About the job
SambaNova is seeking a talented and driven ML performance engineer to optimize and scale state-of-the-art foundation models on SambaNova's reconfigurable dataflow platform. You will work hands-on with advanced models to push the limits of throughput, latency, and efficiency. This role bridges the gap between deep learning and systems performance, collaborating across compiler, runtime, and hardware layers to deliver world-record performance for large-scale AI inference.
Responsibilities
- Optimize and bring up foundation models on the SambaNova platform through its software stack.
- Profile and enhance model performance across compiler, runtime, and hardware layers for SOTA throughput and latency.
- Collaborate with ML, compiler, runtime, and hardware teams to deliver high-performance AI applications.
- Integrate the latest advances in model architecture, quantization, scheduling, and memory optimization.
- Develop scalable and efficient end-to-end inference solutions aligned with customer needs.
- Identify performance bottlenecks and propose dataflow or scheduling optimizations for single-node and distributed systems.
Requirements
- Bachelor's or higher degree in computer science, electrical engineering, or a related field.
- 3+ years of experience in deep learning model development and performance optimization, compiler/runtime/kernel optimization, or software-hardware co-design/systems performance tuning.
- Proficiency in Python or C++ with strong foundations in algorithms, data structures, and numerical computing.
- Experience with at least one major ML framework (PyTorch, TensorFlow, or JAX).
- Demonstrated ability to analyze and optimize performance in real-world ML pipelines.
Benefits
- Equity
- 95% premium coverage for employee medical insurance
- 77% premium coverage for dependents
- Health Savings Account (HSA) with employer contribution
- Dental insurance
- Vision insurance
- Short-term disability insurance
- Long-term disability insurance
- Basic life insurance
- Voluntary life insurance
- Accidental Death & Dismemberment (AD&D) insurance
- Health Care Flexible Spending Account (FSA)
- Limited Purpose Flexible Spending Account (FSA)
- Dependent Care Flexible Spending Account (FSA)
- Full subscription to Headspace
- Gympass+