Technical Program Manager, Model Performance
Remote • San Francisco • FullTime
Posted 15d ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Baseten is seeking a Technical Program Manager to join its Model Performance organization. This is a unique opportunity to build a program framework from scratch, establishing planning structures, execution processes, and cross-functional alignment for a fast-growing team. You will be instrumental in accelerating the productization of performance R&D, directly impacting how quickly cutting-edge AI models are brought to production. If you excel at transforming ambitious initiatives into predictable, well-governed programs, this role is for you.
Responsibilities
- Own execution across the Model Performance project portfolio, allowing technical leads to focus on technical direction.
- Design and implement planning structures, operating cadences, and status reporting mechanisms tailored to the team.
- Coordinate end-to-end model release and optimization programs, including day-zero launches and sequencing work across performance engineering, infra, and release stakeholders.
- Drive cross-team alignment as scope expands from Model Performance Core to Model APIs and the inference production stack.
- Proactively surface risks and dependencies, keeping leadership informed with clear status updates.
- Partner with engineering leads to define team structures and ownership boundaries during organizational scaling.
Requirements
- Extensive technical program management experience, managing programs of similar scope and complexity.
- Experience program-managing model performance or inference optimization, with understanding of engines like vLLM, TensorRT-LLM, SGLang, or NVIDIA Dynamo.
- Demonstrated comfort with ambiguity and building programs from zero-to-one.
- Proven ability to influence engineers, managers, and leadership without direct authority.
- Excellent written and verbal communication skills, capable of making technical programs understandable to any audience.
- High agency and decision-making skills, demonstrating ownership and accountability.
Benefits
- Competitive compensation
- Meaningful equity
- 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy
- Company-wide Winter Break (offices closed from Christmas Eve to New Year's Day)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k)
- Exposure to a variety of ML startups for learning and networking opportunities