Senior / Staff Software Engineer — Platform
$220k - $300k • Remote • New York City, NY (Hybrid); San Francisco, CA (Hybrid)
Posted 1mo ago
About the job
Snorkel AI is seeking experienced Platform Engineers to build and operate the core infrastructure and services powering their AI data platform. This role involves designing and implementing event-driven data flows, agent infrastructure, and systems for data lineage, governance, and auditing. You will play a key role in a foundational architecture shift towards an event-first platform, making decisions that will impact the company's scalability for years to come. The position offers significant ownership and the opportunity to shape the future of Snorkel's platform.
Responsibilities
- Design and build agent infrastructure for speeding up engineering and operations workflows.
- Implement event-driven data flows using event brokers, CDC connectors, schema registries, and dead letter queues.
- Build systems for data lineage, governance (RBAC), auditing, PII handling, and compliance.
- Set strategy and architecture for build systems, testing frameworks, and CI/CD pipelines.
- Instrument services with OpenTelemetry, define and monitor SLOs, and build alerting.
- Contribute to infrastructure cost visibility and optimization.
- Collaborate with cross-functional teams to ensure consistency and high standards in codebases, infrastructure, and processes.
Requirements
- 5+ years of experience building production platform infrastructure, backend services, or data systems.
- Proficiency in Python and experience designing REST APIs.
- Strong background in distributed systems and cloud platforms (AWS preferred), including services like S3, RDS, EKS, EventBridge, and IAM.
- Comfort working in a Terraform-managed environment.
- Familiarity with data orchestration tools (Prefect, Airflow, or Dagster) and transformation frameworks (dbt).
- Understanding of data governance concepts (RBAC, PII handling, audit logging, data lineage).
- Proven track record of leading complex engineering initiatives and influencing stakeholders.
- Ability to work in a fast-paced environment with strong technical communication skills.
- Fluency with modern developer tooling and a willingness to adopt new tools.