Staff Technical Program Manager
Tel Aviv - IL • FullTime
Posted 2mo ago
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Crusoe is building the future of AI infrastructure with an energy-first approach, creating a vertically integrated, sustainable AI cloud. We own and operate every layer of the stack, from power generation to AI workloads, to meet the boundless demand for AI compute. As a rapidly growing company, we are seeking problem-solving individuals who are driven by ambition and eager to shape the future of AI infrastructure.
The Staff Technical Program Manager will play a crucial role in our Managed Inference platform, a fast-growing product area enabling customers to run production LLM workloads without managing underlying infrastructure. This role involves connecting model engineering, IaaS, product, and data center operations to deliver a reliable and scalable inference platform. You will have a unique opportunity to shape the TPM function as it is still being built, owning end-to-end program delivery, model onboarding, inference optimization, and production readiness for new model versions. Deep familiarity with how LLMs are served, optimized, and evaluated in production is essential.
Responsibilities
- Own multi-quarter release planning, dependency governance, and executive communication for the Managed Inference platform.
- Drive model version rollouts, inference optimization, SLA readiness for new GPU hardware, and multi-tenant capacity planning.
- Coordinate across Model Engineering, IaaS, Cloud Foundations, Data Center Operations, and external model providers.
- Identify and mitigate risks related to model serving, reliability, capacity, and vendor timelines.
- Develop and maintain lightweight, scalable TPM frameworks and real-time execution dashboards.
- Manage pre-launch planning for model onboarding on new GPU generations, including firmware, driver, and stack validation.
- Lead stakeholder alignment and effectively push back across engineering, product, and operations leadership.
Requirements
- 7+ years of experience as a Technical Program Manager in fast-paced technical environments.
- Proven track record of owning complex programs end-to-end across engineering and product organizations.
- Working familiarity with LLM inference and model serving, including batching strategies, quantization, and production-scale tradeoffs.
- Familiarity with multi-tenant systems, including isolation, quota management, and SLA enforcement.
- Sufficient familiarity with fine-tuning and alignment workflows to govern timelines and identify technical risks.
- Proven ability to build execution models in low-structure environments.
- Exceptional written and verbal communication skills for executive stakeholders.
- Active, daily use of AI tools to improve program execution, risk detection, and communication.
- Proven ability to drive cross-functional alignment without direct authority.
Benefits
- Competitive benefits package designed to support financial security, health, and overall well-being.
- Benefits tailored to local market standards.