Compute Strategy & Operations Lead
New York • FullTime
Posted 5mo ago
Job Location
New York
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Modal is building the next-generation infrastructure layer for AI, enabling companies to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We are seeking a Compute Strategy and Operations Lead to manage the end-to-end procurement of GPU and CPU capacity. This role is critical as the compute secured directly impacts Modal's ability to sell and build its offerings. The ideal candidate will be responsible for anticipating infrastructure needs, sourcing supply from various providers, and negotiating contracts to ensure sufficient capacity.
Responsibilities
- Own end-to-end procurement of GPU and CPU capacity across hyperscalers, neoclouds, and datacenter operators
- Build and maintain a strong pipeline of supplier relationships
- Evaluate supply options based on price, availability, hardware specifications, networking capabilities, and SLA terms
- Negotiate and close contracts, including reserved capacity agreements, spot arrangements, MSAs, DPAs, and order forms
- Collaborate with engineering teams to translate technical requirements into procurement specifications
- Track market pricing, availability trends, and supplier dynamics to advise leadership on infrastructure procurement decisions
Requirements
- Fluency in the AI infrastructure landscape, including hyperscalers, neoclouds, and the GPU supply market
- Technical understanding of GPU architectures (e.g., NVIDIA H100/H200/B200), networking (InfiniBand vs. RoCE, fabric topology), and SLA structures
- Strong commercial instincts with the ability to identify leverage, structure deals, and close them
- Ability to work cross-functionally with finance and engineering teams on commercial terms and technical requirements