Senior Backend Software Engineer, AI Observability & Evals Platform (NYC)
$180k - $240k • New York, NY • FullTime
Posted 14h ago
About the job
LangChain is seeking a Senior Backend Engineer to join their AI Observability & Evals Platform team. This role involves building the backend systems that power LangChain's observability and evaluation platform, enabling developers to monitor and evaluate AI applications at scale. The position offers the opportunity to contribute to core services and shape the future of AI observability in production environments. While the primary focus is on backend development, experience with full-stack or frontend engineering, performance tuning, and debugging production issues would be highly beneficial.
Responsibilities
- Design, develop, and maintain backend services and APIs for tracing, monitoring, and evaluation workflows.
- Collaborate on architectural decisions for performant and maintainable systems.
- Optimize storage and query performance for high-volume data.
- Ensure system reliability through testing, monitoring, and alerting.
- Troubleshoot and resolve production issues, including root-cause analysis.
- Create and maintain technical documentation.
- Work with cross-functional teams on new feature rollouts.
Requirements
- 5+ years of professional experience in backend engineering on complex products.
- Proficiency in backend languages/frameworks, preferably Python or Go.
- Strong understanding of API design and building reliable data services.
- Experience with high-throughput or mission-critical systems.
- Demonstrated ability to optimize backend services for performance and reliability.
- Experience with database systems (Postgres, Redis, Clickhouse).
- Experience with cloud platforms (AWS, GCP, Azure).
- Strong communication and cross-functional collaboration skills.
- Customer centricity and ownership mentality.
Benefits
- Competitive base salary
- Variable compensation
- Meaningful equity
- Medical, dental, and vision coverage
- Flexible vacation
- 401(k) plan
- Meals on in-office days (US)