AI Performance Engineer - New Grad
$131k - $197k • Austin, Texas, United States; San Jose, California, United States
Posted 12h ago
About the job
As a new grad AI Performance Engineer, you will be responsible for bringing up new open-source foundation models on the SambaNova dataflow platform and optimizing their performance. This involves profiling model execution, identifying performance bottlenecks across compiler, runtime, and hardware layers, and applying optimizations such as quantization, kernel fusion, and improved scheduling. You will collaborate with machine learning, compiler, runtime, and hardware teams to integrate performance improvements into SambaNova products and benchmark throughput and latency to track changes across releases.
Responsibilities
- Bring up new foundation models on the SambaNova platform using the software stack.
- Profile model performance across compiler, runtime, and hardware layers.
- Identify bottlenecks and propose dataflow or scheduling optimizations for single-node and distributed systems.
- Apply techniques from recent research in quantization, scheduling, and memory optimization.
- Benchmark throughput and latency and track performance changes across releases.
- Collaborate with machine learning, compiler, runtime, and hardware teams to ship performance improvements into SambaNova products.
Requirements
- B.S. in Computer Science, Electrical Engineering, or related field.
- Strong programming skills in Python or C++.
- Understanding of algorithms, data structures, and numerical computing.
- Experience with PyTorch, TensorFlow, or JAX.
- Experience with inference frameworks such as vLLM, TensorRT, or SGLang.
- GPU programming experience with CUDA or Triton.
Benefits
- Equity
- 95% premium coverage for employee medical insurance
- 77% premium coverage for dependents
- Health Savings Account (HSA) with employer contribution
- Dental insurance
- Vision insurance
- Short-term disability insurance
- Long-term disability insurance
- Basic life insurance
- Voluntary life insurance
- Accidental Death & Dismemberment (AD&D) insurance
- Flexible Spending Account (FSA) options (Health Care, Limited Purpose, Dependent Care)
- Headspace subscription
- Gympass+ membership
- One Medical membership
- Counseling services with an Employee Assistance Program