Staff+ Software Engineer, Distributed Systems
$320k - $485k • New York City, NY; San Francisco, CA
Posted 1mo ago
Job Location
New York City, NY; San Francisco, CA
Tech Stack
Remote Work Policy
On-site
Categories
AI Infrastructure Engineer
About the job
We are seeking software engineers to join our Safeguards team, focusing on building robust safety and oversight mechanisms for our AI systems. This role involves developing distributed and scalable systems to monitor models, prevent misuse, and ensure user well-being. You will work to detect unwanted model behaviors and prevent disallowed use, applying your technical skills to uphold principles of safety, transparency, and oversight while enforcing terms of service and acceptable use policies.
Responsibilities
- Independently scope and lead complex, multi-month infrastructure projects from ambiguity to production.
- Develop monitoring systems to detect unwanted behaviors from API partners and potentially take automated enforcement actions, surfacing them in internal dashboards.
- Deploy and manage monitoring systems across multiple clouds, ensuring consistency through shared deployment pipelines, smoke tests, observability, and alerting.
- Design and harden sandboxed runtimes for AI agents, focusing on isolation, network egress controls, least-privilege data access, audit logging, and insider-risk controls.
- Manage cost and capacity for large volumes of long-running agent work, meeting service-level objectives.
- Partner with engineers, researchers, security, privacy, and legal teams to enable rapid deployment of new detection work on a trusted platform.
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, or comparable experience.
- Proficiency in Python, Distributed Systems, and Infrastructure as Code.
- Experience working across multiple cloud providers or building provider-agnostic infrastructure.
- Experience building and operating large-scale, distributed infrastructure (e.g., data platforms, control planes, job schedulers).
- Experience with sandboxing and isolation technologies (containers, microVMs, network policy) or with a systems language like Rust.
- Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders.