Technical Lead Manager - Training Runtime, Data(set) Movement
4mo ago
OpenAI is seeking a deeply hands-on Technical Lead Manager to own datasets throughout our training infrastructure. This role will define the future of how training jobs access data, encompassing APIs, storage contracts, versioning, benchmarks, debugging tools, and reliability guarantees to ensure consistent data access across current and future training frameworks. Initially, you will be the primary technical owner for dataset reads, working directly with code and collaborating with researchers, training framework owners, storage teams, and infrastructure partners to build a durable platform. The challenge lies in making enormous, heterogeneous datasets easy to consume, correct across distributed workers, observable, and flexible enough to support various training modalities at frontier scale. The long-term vision is to build a team responsible for fast, correct, scalable, and reliable in-cluster data movement for training, expanding ownership beyond datasets to include checkpoint loads/saves and snapshot transfers.
$380k - $500k
San Francisco remote FullTime OpenAIPythonRust +9 more