Senior Backend Software Engineer, AI Observability & Evals Platform (LangSmith)
$170k - $235k • Boston, MA • FullTime
Posted 1mo ago
Job Location
Boston, MA
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Engineer
About the job
LangChain is seeking a Senior Backend Engineer to join their growing engineering team in Boston, MA. This role will focus on building the backend systems that power LangSmith, LangChain's observability and evals platform. You will work on core services enabling customers to monitor and evaluate their AI applications at scale. While the primary focus is backend feature development, familiarity with full-stack engineering, performance tuning, and debugging production issues is beneficial. This is an opportunity to shape the future of AI observability at production scale.
Responsibilities
- Design, develop, and maintain backend services and APIs for LangSmith's tracing, monitoring, and evaluation workflows.
- Collaborate on architectural decisions to ensure system performance and maintainability.
- Optimize storage and query performance for high-volume observability and evaluation data.
- Ensure system reliability through testing, monitoring, and alerting.
- Troubleshoot and resolve production issues, including root-cause analysis and implementing fixes.
- Create and maintain technical documentation, such as system designs and API references.
- Work closely with full-stack engineers, product managers, and designers on new feature rollouts.
Requirements
- 4+ years of professional experience in backend engineering on complex products.
- Proficiency in backend languages/frameworks, ideally Python and/or Go.
- Strong understanding of API design and building reliable data services.
- Experience with high-throughput, mission-critical systems.
- Demonstrated ability to optimize backend services for performance and reliability.
- Experience with database systems (Postgres, Redis, Clickhouse) is a bonus.
- Experience with cloud platforms (AWS, GCP, Azure) is a bonus.
- Strong communication and cross-functional collaboration skills.
- Customer-centricity and ownership mentality.
Benefits
- Medical, dental, and vision coverage
- Flexible vacation
- 401(k) plan
- Meals on in-office days
- Meaningful equity
- Variable compensation