Member of Engineering (Inference Infrastructure)
Remote • Remote (EMEA) • FullTime
Posted 2mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Poolside is building a world where AI drives economically valuable work and scientific progress, aiming to accelerate software development with agentic systems, coding assistants, and frontier models. This role is on the compute team, focusing on optimizing GPU workload scheduling and inference serving. You will partner with the inference team to enhance throughput and latency for evaluations and reinforcement learning, collaborate with the scalability team to stabilize large-scale fault-tolerant training, and work closely with the infrastructure team to ensure GPU nodes are healthy and fully utilized. Your work will directly impact research velocity and contribute to the company's mission of building frontier models.
Responsibilities
- Design and develop an internal scheduling system to maximize GPU utilization.
- Build APIs and tooling to manage the lifecycle of GPU workloads and troubleshoot failures.
- Design and improve the inference control plane to speed up model deployment and inference request serving.
- Collaborate with research teams to continuously improve research velocity.
Requirements
- Strong programming skills in Go or similar languages.
- Strong systems engineering background, including distributed systems, schedulers, control planes, or high-throughput data planes.
- Production experience with Kubernetes internals (controllers, informers, operators), not just deploying to it.
- A bias toward observability and debuggability in system design.
- Experience in systems serving large-scale inference requests is a plus.
Benefits
- Fully remote work and flexible hours.
- 37 days per year of vacation and holidays.
- Health insurance allowance for employee and dependents.
- 16 weeks of flexible, full-pay parental leave.
- Allowances for well-being, continuous learning, and home office.
- Company-provided equipment.
- Frequent team get-togethers.
- Diverse and inclusive people-first culture.