Software Engineer, Fleet Management
San Francisco • FullTime
Posted 9mo ago
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
The Fleet team at OpenAI supports the computing environment that powers our cutting-edge research and product development. We oversee large-scale systems that span data centers, GPUs, networking, and more, ensuring high availability, performance, and efficiency. Our work enables OpenAI’s models to operate seamlessly at scale, supporting both internal research and external products like ChatGPT. We prioritize safety, reliability, and responsible AI deployment over unchecked growth. The Software Engineer, Operating Systems & Orchestration will focus on building systems to manage hardware, configurations, vendors, and the people interacting with our infrastructure. You will design and develop solutions that integrate individual nodes and servers into unified clusters, directly contributing to advancing AI research by streamlining the overall research user experience.
Responsibilities
- Design and build systems to manage cloud and bare-metal fleets at scale.
- Develop tools that integrate low-level hardware metrics with high-level job scheduling and cluster management algorithms.
- Leverage LLMs to coordinate vendor operations and optimize infrastructure workflows.
- Automate infrastructure processes to reduce toil and improve system reliability.
- Collaborate with hardware, infrastructure, and research teams for seamless integration.
- Continuously improve tools, automation, processes, and documentation for operational efficiency.
Requirements
- Strong software engineering skills with experience in large-scale infrastructure environments.
- Broad knowledge of cluster-level systems (e.g., Kubernetes, CI/CD pipelines, Terraform, cloud providers).
- Deep expertise in server-level systems (e.g., systems, containerization, Chef, Linux kernels, firmware management, host routing).
- Passion for optimizing the performance and reliability of large compute fleets.
- Ability to thrive in dynamic environments and solve complex infrastructure challenges.
- Value automation, efficiency, and continuous improvement.
Benefits
- Relocation assistance