Senior Backend Engineer (Data Infrastructure)
Remote • Europe • FullTime
Posted 6mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Langfuse is building the "Datadog" for LLM engineering platforms, offering tracing, evaluation, and prompt management. As part of ClickHouse, we are scaling our open-source platform to process terabytes of AI tracing data daily for thousands of AI teams, including 19 of the Fortune 50. We are seeking a Senior Backend Engineer to own and scale the infrastructure that powers this data-intensive platform. Your work will directly impact the performance and affordability of Langfuse at scale, optimizing ingestion pipelines, ClickHouse data models, and backend abstractions. You will also ensure Langfuse runs seamlessly across cloud and self-hosted environments, with direct access to the ClickHouse database engineering team.
Responsibilities
- Own and optimize the ingestion pipeline for throughput, latency, reliability, and cost efficiency.
- Design ClickHouse schemas, optimize merge strategies, tune batch inserts, and write/review analytical queries.
- Build new infrastructure-heavy features such as LLM-as-a-Judge, alerting at scale, client-code execution, or batch dataset operations.
- Test infrastructure changes with real production data using load tests and parallel runs.
- Anticipate and address scaling challenges for future product directions, such as agent observability and real-time evaluation.
- Operate Langfuse Cloud across multiple production environments.
- Support deployment from single Docker Compose setups to enterprise-grade Helm charts.
Requirements
- Strong backend engineering skills with a focus on database internals, query optimization, and distributed systems.
- Excitement for working with large volumes of data.
- Experience with analytical databases, data pipelines, or high-throughput event processing.
- Ability to self-organize and strong opinions on building and shipping solutions.
- Proficiency in reading and writing TypeScript and SQL.
- Interest in open-source software and engaging with users on scaling challenges.
- Ability to thrive in a small, accountable team with visible output.
- CS or quantitative degree preferred.