Platform Engineer
$250k - $350k • San Francisco • FullTime
Posted 1y ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
E2B is seeking an infrastructure engineer to build the next cloud platform for running AI software, where AI applications will create other software applications. The role involves developing a distributed system to manage millions and billions of AI agents, creating an orchestrator for sandbox placement, and enabling live sandbox migrations. A key focus will be on optimizing the developer experience for open-source self-hosting and ensuring rapid sandbox startup times, aiming for under 200ms from user input to execution. The position requires scaling the platform to handle billions of concurrent sandboxes and building a comprehensive observability stack from the virtual machine kernel level upwards. The ideal candidate is passionate about high-performance, efficient, and large-scale infrastructure.
Responsibilities
- Build a distributed system for millions and billions of AI agents.
- Develop an orchestrator for placing sandboxes on appropriate nodes.
- Add support for live sandbox migrations.
- Improve the self-hosting developer experience for open-source users.
- Ensure sandbox startup times are under 200ms.
- Scale the platform to support millions and billions of concurrent sandboxes.
- Build an observability stack starting at the virtual machine kernel level.
Requirements
- 5+ years of experience building distributed systems at scale (100K+ RPS, multi-region, PB-scale data).
- Deep expertise in Linux internals, including kernel-level debugging with eBPF, CPU scheduling, and memory management.
- Experience with VM hypervisors like Firecracker, QEMU, or KVM, including understanding virtio and hypercalls.
- Strong systems programming skills in Go, Rust, C/C++, with experience in performance-critical code.
- Production orchestration experience with systems like Kubernetes or Nomad, including bin-packing and resource scheduling.
- Obsession with performance, including shaving milliseconds off hot paths and understanding CPU caches and memory locality.
- Strong understanding of L4/L7 load balancing, network namespaces, and iptables/nftables.
- Located in San Francisco or willing to relocate.
- Comfortable with open-source contributions and clear documentation.
Benefits
- Healthcare, vision, and dental insurance
- Unlimited PTO
- 401k
- Perks for in-office employees