Staff Engineer, Data Platform
$192k - $288k • Cambridge, MA USA; San Francisco, CA USA • Full-time
Posted 5mo ago
This job has been open for more than 60 days. It may no longer be actively hiring, so check with the company before putting a lot into an application.
About the job
Lila Sciences is seeking a Staff Engineer to lead the technical direction of its core data infrastructure. This role involves designing and evolving systems for ingesting, storing, and serving data critical to scientific discovery and machine learning workflows. You will work closely with scientists and researchers to translate requirements into robust platform capabilities, establish architectural patterns and engineering standards, and mentor other engineers. The position is ideal for individuals passionate about data system design who want to make impactful technical decisions.
Responsibilities
- Design and evolve core data infrastructure for ingestion, storage, and serving across scientific and ML workflows.
- Build reliable pipelines for ingesting data from diverse sources like lab instruments and public datasets.
- Operate and extend workflow orchestration systems for complex scientific pipelines, ensuring observability and reliability.
- Define and maintain data models, schema evolution practices, and data contracts.
- Partner with ML researchers, scientists, and engineers to translate requirements into platform capabilities.
- Establish coding, review, and design standards for the data platform team and mentor engineers.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 8+ years of experience in software or data engineering focused on data infrastructure.
- Experience designing and shipping data platform components (ingestion, storage, orchestration).
- Proficiency in Python and SQL, with experience writing production-quality code.
- Production experience with relational and NoSQL databases, schema design, and query optimization.
- Experience with cloud infrastructure and containerized deployment (AWS, Kubernetes).
- Hands-on experience with modern table formats and open lakehouse patterns (Iceberg, Delta Lake, Hudi).
- Proven ability to work cross-functionally and translate domain requirements into technical decisions.
Benefits
- Competitive base compensation with bonus potential
- Generous early-stage equity
- Comprehensive medical, dental, and vision coverage (U.S.)
- Employer-paid life and disability insurance (U.S.)
- Flexible time off with generous company-wide holidays (U.S.)
- Paid parental leave (U.S.)
- Educational assistance program (U.S.)
- Commuter benefits, including bike share memberships (U.S.)
- Company-subsidized lunch program (U.S.)
- International benefits tailored to region