Developer Productivity
$175k - $240k • San Francisco, CA • FullTime
Posted 3d ago
About the job
LangChain is seeking a Software Engineer to join its Infrastructure team, focusing on enhancing developer productivity across its LangGraph Cloud/Platform and LangSmith products. This role involves close collaboration with Infrastructure, Backend, and Frontend teams to ensure confident deployment of services, APIs, and UI flows. A key aspect of this position will be pioneering quality practices specifically for LLM applications, including prompt regression testing and comprehensive evaluation suites. The ideal candidate will contribute to building and maintaining the systems that power LangChain's developer platform, emphasizing reliability, scalability, and overall developer efficiency.
Responsibilities
- Own end-to-end test strategy for APIs, services, UI, data, and infrastructure (Kubernetes, Terraform, Helm).
- Establish ephemeral test environments in Kubernetes for pull requests and release candidates, including seeding test data and running hermetic test suites.
- Integrate quality checks earlier into CI/CD pipelines (GitHub Actions) through parallelization, caching, deterministic seeds, flake tracking, and quality gates.
- Develop observability within testing workflows, providing rich failure artifacts like logs, traces, and dashboards.
- Define performance and reliability baselines for critical paths, including SLIs, SLOs, and regression detection.
- Support incident response by reproducing issues, implementing targeted regression tests, and enhancing runbooks and postmortems.
- Create documentation such as test plans, playbooks, and contributor guidelines for high-quality testing.
Requirements
- 3+ years of experience as a software engineer or infrastructure engineer.
- Strong hands-on experience with Python and testing frameworks like pytest.
- Experience with CI/CD systems (GitHub Actions preferred) and improving pipeline performance and reliability.
- Solid understanding of API testing, mocking/stubbing, and data setup/teardown.
- Comfort defining quality standards, writing test plans, and driving cross-team execution.
Benefits
- Medical, dental, and vision coverage
- Flexible vacation
- 401(k) plan
- Meals on in-office days (US)
- Meaningful equity
- Variable compensation