Senior Software Engineer — Backend (Files Team)
$166k - $225k • Remote • San Francisco, California
Posted 15d ago
About the job
Databricks is seeking a Senior Software Engineer for its Files team to innovate at the intersection of storage, performance, and distributed systems. This role will directly shape the company's filesystem strategy to power next-generation agentic workloads. The Filesystem has emerged as a preferred runtime interface for AI agents, serving as a foundational layer for context, memory management, artifact authoring, version control, sandboxing, and inter-system communication, thereby accelerating AI adoption.
Responsibilities
- Design, build, and operate the filesystem platform that powers tens of thousands of data, AI, and agentic workloads daily.
- Enhance filesystem performance for demanding workloads by profiling and optimizing across the entire stack, from the API layer to the Linux kernel.
- Collaborate with cross-functional teams to design and evolve next-generation compute and storage architectures.
- Define the technical direction for content organization within Databricks, standardizing on filesystem primitives applicable to all product surfaces.
Requirements
- Bachelor's degree in Computer Science or a related field.
- 5+ years of production-level experience in Java, Scala, C++, Go, Rust, or a similar language.
- 3+ years of experience developing large-scale distributed systems.
- Experience with Kubernetes, Docker, or MicroVM technologies (e.g., Firecracker).
- Strong understanding of cloud provider internals (AWS/Azure/GCP).
- Experience building tools from the ground up when existing solutions are insufficient.
- Experience with filesystems and FUSE.
- Experience building object/blob storage (S3, Azure Blob Storage, GCS etc).
- Experience with systems performance engineering across microservices, down to the Linux level.
- Background in high-scale content, storage, or file-sync products.
Benefits
- Eligibility for annual performance bonus
- Equity
- Comprehensive benefits and perks (specific details vary by region)