Software Engineer, Context Engine
$230k - $390k • San Francisco, CA • FullTime
Posted 6h ago
About the job
Sierra is seeking a Software Engineer to join our full-stack data team, focused on enhancing the intelligence of AI agents. You will build real-time pipelines, analytics products, and personalization systems that leverage millions of conversations to drive business outcomes. This role involves architecting and developing our core data platform for low-latency, large-scale data processing, including real-time eventing, ETL pipelines, and a data lakehouse. You will also develop systems for long-term agent memory, customer data platforms, and optimization loops to personalize agent interactions and improve business results. The ideal candidate is passionate about AI products and thrives in a high-autonomy environment.
Responsibilities
- Architect and build core data platform for large-scale, low-latency data processing.
- Develop real-time eventing infrastructure and streaming/batch ETL pipelines.
- Own systems for interactive OLAP querying, orchestration, and experimentation.
- Develop systems for long-term agent memory and reusable Customer Data Platform (CDP) primitives.
- Implement optimization loops for agent personalization and business outcome improvement.
- Build and ship data products, including analytics dashboards and data visualization tools.
- Design and implement performant APIs and intuitive user interfaces for data exploration.
- Integrate ML-powered features such as personalization and recommendations into products.
Requirements
- 4-7+ years of hands-on development experience building and shipping production systems or products.
- Depth in platform engineering, including designing, building, and operating large-scale data systems (terabytes/petabytes) with technologies like Spark, Flink, Trino/Presto, and data lakehouse formats (Iceberg, Hudi).
- Strong backend and distributed systems fundamentals in languages like Go, Scala, or Python.
- Experience with data governance, lineage, and testing, building cost-aware and operable platforms.
- Proficiency in data modeling best practices (dimensional modeling, star/snowflake schemas, slowly changing dimensions).
- Experience in product engineering, including shipping data products like analytics dashboards or visualization tools.
- Skilled full-stack engineer with experience in TypeScript/React and a service layer like Go.
- Ability to translate ambiguous questions into clear, intuitive interfaces with strong product sense.
- Practical experience with ML-powered product features (personalization, recommendations, classification).
- Passion for being on the frontier of AI products.
- High agency and bias to action in a high-autonomy environment.
- Degree in Computer Science or related field, or equivalent professional experience.