Member of Technical Staff (Software Engineer, Model Platform)
San Francisco • FullTime
Posted 19d ago
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Perplexity AI is seeking a deeply technical software engineer to own and evolve its model serving platform. This mission-critical system connects products and research systems with inference layers, providing a fast and reliable interface across providers. The role involves working at the intersection of distributed systems, AI products, and infrastructure, making it easier for teams to adopt new models, run experiments, and ship dependable products. The ideal candidate will possess strong technical judgment, curiosity about frontier models, and experience designing core abstractions and leading technical decisions.
Responsibilities
- Own and evolve the model serving platform.
- Connect products and research systems with inference layers.
- Design core abstractions.
- Lead high-conviction technical decisions.
- Write production Rust and Python for a service serving hundreds of millions of model requests per day.
- Make it easier for teams to adopt new models, run experiments, and ship dependable products.
Requirements
- 5+ years of experience building and shipping large-scale systems and services with high reliability, availability, and performance.
- Strong software engineering craft, with special care for developer experience and designing future-proof systems.
- Proficiency with a general-purpose backend language (Python, Rust, C++, Go).
- Proficiency with cloud infrastructure (AWS, Kubernetes).
- BS, MS, or PhD in Computer Science, Engineering, or related fields (or equivalent experience).