Inference Systems Performance Architect
$245k - $325k • Remote • San Jose, California, United States
Posted 17h ago
Job Location
San Jose, California, United States
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
SambaNova is seeking an Inference Systems Performance Architect to lead the end-to-end performance strategy for their AI inference platform. This role involves defining and driving technical direction in workload capture, benchmarking, modeling, and simulation. You will be instrumental in understanding how requests move through the system, from tokenization to fabric communication, and how deployments meet customer service level objectives. The work focuses on creating reproducible representations of real and agentic traffic, developing what-if capabilities for future configurations, and tackling complex challenges in heterogeneous inference environments.
Responsibilities
- Define and drive the technical strategy for inference systems performance, including workload capture, benchmarking, modeling, and simulation.
- Build workload capture and agentic benchmarking capabilities to represent production traffic accurately.
- Own the performance modeling and simulation practice to predict configuration changes and inform capacity planning.
- Address the end-to-end profiling gap by driving tooling to localize bottlenecks across host, accelerator, and fabric.
- Serve as the senior technical voice across model optimization, systems, hardware, and product teams.
- Act as a resource for the organization, representing SambaNova's performance story to customers and partners.
- Mentor and elevate the capabilities of principal and senior engineers.
- Drive the resolution of ambiguous, novel challenges that span organizational boundaries.
Requirements
- B.S. in Computer Science, Computer Engineering, or Related Field.
- 12+ years of experience in performance engineering with a record of technical leadership on large-scale systems.
- Deep expertise in end-to-end performance analysis of distributed systems.
- Proven command of realistic workload generation, simulation, and performance modeling.
- Demonstrated ability to apply core performance methods in unfamiliar domains.
- Ability to lead cross-functional efforts, mentor senior engineers, and influence organizational direction.
- Experience representing an organization credibly to customers and partners.
- Track record of independently scoping and delivering high-complexity, high-ambiguity work.
Benefits
- Base Salary Range: $245,000 - $325,000 USD