Senior Backend Software Engineer, AI Observability & Evals Platform (LangSmith)
$180k - $240k • Boston, MA • FullTime
Posted 2d ago
About the job
LangChain is seeking a Senior Backend Engineer to join their growing engineering team in Boston, MA. This role will focus on building the backend systems that power LangSmith, the company's observability and evaluation platform for AI applications. You will work on core services enabling customers to monitor and evaluate their AI applications at scale. While the primary focus is backend development, familiarity with full-stack or frontend engineering, performance tuning, and debugging production issues is beneficial. This is an opportunity to shape the future of AI observability at production scale.
Responsibilities
- Design, develop, and maintain backend services and APIs for LangSmith's tracing, monitoring, and evaluation workflows.
- Collaborate on architectural decisions to ensure system performance and maintainability.
- Optimize storage and query performance for high-volume observability and evaluation data.
- Ensure system reliability through testing, monitoring, and alerting.
- Troubleshoot and resolve production issues, including root-cause analysis and implementing fixes.
- Create and maintain technical documentation, including system design and API references.
- Work closely with full-stack engineers, product managers, and product designers on feature rollouts.
Requirements
- 4+ years of professional experience in backend engineering on highly complex products.
- Proficiency in backend languages/frameworks, ideally Python and/or Go.
- Strong understanding of API design and building reliable data services.
- Experience with high-throughput, mission-critical systems.
- Demonstrated ability to optimize backend services for performance and reliability.
- Experience with database systems (Postgres, Redis, Clickhouse) is a bonus.
- Experience with cloud platforms (AWS, GCP, Azure) is a bonus.
- Strong communication and cross-functional collaboration skills.
- Customer centricity and ownership mentality.
Benefits
- Medical, dental, and vision coverage
- Flexible vacation
- 401(k) plan
- Meals on in-office days
- Competitive compensation
- Variable compensation
- Meaningful equity