Software Engineer, Networking (Agent Infra)
$160k - $330k • Remote • San Francisco • FullTime
Posted 5h ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Baseten powers mission-critical inference for leading AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling. We enable companies at the frontier of AI to bring cutting-edge models into production. The Agent Infra team builds a custom networking stack for our sandboxes, designed for the scale of numerous isolated machines that constantly suspend, resume, and exchange data. This role focuses on building a user-space networking stack using VPP, enabling multi-tenant virtual private networking for agents and services.
Responsibilities
- Design and build the user-space, VPP-based data plane connecting microVM sandboxes to each other, Baseten services, and the internet.
- Develop multi-tenant virtual private networking and overlays (e.g., EVPN, GENEVE, VXLAN) across regions.
- Expose the network as a programmable API for platform integration.
- Reduce latency and increase connection scale for agent-to-agent and agent-to-service traffic.
- Implement routing for regional proximity and connection resilience during sandbox suspension/resumption.
- Build secure ingress and egress for sandboxes, including firewalling, static egress IPs, and custom domains with managed TLS.
- Develop L7 proxies for request inspection, filtering, secret injection, and auditing.
- Manage per-sandbox addressing, including IPv6, and ensure network isolation between tenants.
- Build observability for the packet path across guest, host, and network, and debug end-to-end production issues.
- Collaborate closely with compute, storage, GPU infrastructure, and datacenter teams.
Requirements
- Experience with user-space packet processing (DPDK, VPP, or similar) or virtualized network functions (VNF/NFV).
- Experience building multi-tenant networking in production (VXLAN, GENEVE, VRF).
- Experience building a software-defined network, overlay network, or packet-processing data plane in production.
- Strong systems programming skills in Rust, Go, and/or C/C++ for production code development.
- Experience building cloud networking as a provider, not just a consumer.
- Solid understanding of TCP/IP and routing principles.
- Experience building or operating proxies, load balancers, or L4/L7 gateways at scale.
- Experience debugging latency and throughput issues using packet captures, tracing, and profiling.
- Ability to move fast and own problems end-to-end in a small team environment.
Benefits
- Competitive compensation, including meaningful equity
- 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
- Flexible PTO policy including company-wide Winter Break
- Paid parental leave
- Fertility and family-building stipend
- Company-facilitated 401(k) (U.S. only)
- Exposure to a variety of ML startups for learning and networking opportunities