Observability Jobs

LangChain is seeking a Fullstack Engineer to join the LangSmith team, focusing on our commercial AI observability and evaluation platform. This role offers the chance to develop new features and functionality, collaborating closely with enterprise customers, developer end-users, and internal stakeholders. You will contribute to a product that is shaping the future of AI agents in the real world, leveraging a strong foundation in open-source tools and a rapidly growing platform.

$145k - $180k

OpenRouter is seeking its first AI Inference SRE to ensure the operational health of its provider supply. This role will focus on making sure every endpoint is fast, correct, and available, and that problems are detected and routed around before customers are impacted. The SRE will be responsible for building and owning monitoring systems, improving detection and failover mechanisms, and managing incident response for provider-related issues. This position involves holding providers accountable through telemetry and SLO reporting, detecting quality regressions, automating manual operational tasks, and building tooling for capacity planning and launch readiness.

$245k - $295k

Databricks

Databricks' Model Serving product offers enterprises a unified, scalable, and governed platform for deploying and managing AI/ML models, including traditional ML and large language models. It provides real-time, low-latency inference, governance, monitoring, and lineage, making it a core pillar for customers operationalizing models at scale with strong SLAs and cost efficiency. As a Senior Engineer, you will be instrumental in shaping both the product experience and the foundational infrastructure of Model Serving. You will design and build high-throughput, low-latency inference systems for CPU and GPU workloads, influence architectural direction, and collaborate with cross-functional teams to deliver a world-class serving platform.

$166k - $225k

OpenAI

API Agents is building the shared agent harness, tools, and infrastructure that turn OpenAI’s frontier models into systems capable of reliably completing real work. This role focuses on building the core systems behind the next generation of agents, designing reliable services and abstractions that help agents find context, use tools, retain knowledge, coordinate workflows, and take action safely. The position combines deep backend and infrastructure work with strong product judgment, offering opportunities to work across agent runtimes, orchestration, search, execution environments, identity, observability, and evaluations. Success in this role hinges on strong backend fundamentals, high agency, and the ability to translate fast-moving research into dependable production primitives.

$266k - $445k

Physical Intelligence is building general-purpose AI for the physical world, developing foundation models and learning algorithms for robots and future physically-actuated devices. The Infrastructure team is central to this mission, building and operating the backbone for training state-of-the-art VLA models, large-scale simulation, and reliable deployment of intelligence across robot fleets. This role involves collaborating closely with researchers, robotics runtime, product, and platform engineers to ensure infrastructure scales from prototype to production-grade deployments.

LangChain is seeking a Senior Fullstack Engineer to join the team building LangSmith, their commercial observability and evals platform. This role offers the opportunity to significantly influence the platform's technical direction while collaborating with enterprise customers, developer end-users, and internal stakeholders. You will be instrumental in shaping the future of AI agent engineering by contributing to a product used by a significant portion of the Fortune 500.

$175k - $240k

LangChain is building the foundation for agent engineering, enabling developers to create production-ready AI agents. With significant funding and a rapidly growing platform, the company offers open-source tools and a comprehensive platform for building, evaluating, deploying, and operating agents at scale. The LangSmith team specifically focuses on building the core platform for observability, evaluation, and production reliability of AI systems, including tracing, annotation, and run rules. This role is crucial for defining what AI observability looks like at production scale.

$180k - $240k

The Developer Experience team at Moveworks builds platforms that empower developers working on the Moveworks Agentic AI platform. This role is central to owning the technical foundation for the team's output, focusing on designing and building complex platform challenges related to generality, scalability, and extensibility, all while prioritizing the developer experience. The ideal candidate thinks in systems, ships impactful solutions, and effectively collaborates with and influences others.

$191k - $334k

Reducto is seeking a Software Engineer for its Platform team to own the infrastructure behind the company's core API. This role involves ensuring document understanding systems are fast, reliable, and cost-efficient at scale. You will work across Python services, queues, model-serving, Kubernetes, observability, and developer tooling to enhance the platform's robustness. This is a high-leverage infrastructure position for someone who has built and operated production systems, prioritizes latency, reliability, and cost, and is adept at using modern LLM coding tools.

$200k - $325k

Commure is building the AI Operating System for healthcare, transforming how care is delivered, documented, and financed. Our platform encompasses Ambient AI for documentation, intelligent Agents for workflows, and autonomous RCM, all integrated with numerous EHRs. We are seeking a Staff Backend Engineer to help build and operate the foundation for our next-generation ambient AI product suite. This role involves working across audio ingestion, media processing, inference orchestration, distributed workflows, storage, observability, and cloud infrastructure, focusing on making complex systems dependable and ensuring they create a fast, reliable, and trustworthy experience for clinicians.

$210k - $275k

d-Matrix is at the forefront of software and hardware innovation, aiming to unleash the potential of generative AI. We foster a culture of respect, collaboration, humility, and direct communication, valuing diverse perspectives to create better solutions. We are seeking passionate individuals driven by execution to join us in shaping the future of AI. As a Staff-level individual contributor on the Software Infrastructure team, you will drive the automation for our CI/CD and release pipeline. This involves diagnosing and fixing pipeline failures, such as identifying real regressions, flaky hardware, or infrastructure issues, and pinpointing the exact merge that caused overnight test failures. You will blend AI techniques with traditional software automation to build highly reliable systems and architect compute and storage solutions across cloud and on-prem environments. Your role will involve partnering with various teams to develop and spread best practices, reducing developer toil and accelerating development velocity.

$155k - $235k

Elastic is seeking a Principal Software Engineer to join the Elasticsearch - Storage Engine team. This globally distributed, fully remote team focuses on developing core storage and query technologies for observability workloads. The role involves improving storage efficiency, advancing query processing and performance, and optimizing data layouts. The ideal candidate will drive the technical vision, architecture, and design of Elasticsearch's core storage and query engine, with a proven track record in high-performance, scalable database or search engine technologies and the ability to lead technical initiatives across organizations.

$160k - $304k

Elastic is seeking a Principal AI Ecosystem Architect to lead technical strategy and relationships with key AI providers, specifically OpenAI and Anthropic. This individual contributor role involves driving co-build strategies through deep integrations, influencing Elastic's product roadmap, building prototypes, and shaping go-to-market content. The architect will own end-to-end technical relationships, bringing both technical depth and practical experience to demonstrate how Elastic's retrieval capabilities can be leveraged with frontier AI for unstructured enterprise data.

$184k - $291k

Elastic is seeking a Principal AI Ecosystem Architect to lead technical strategy and relationships with key AI providers, specifically OpenAI and Anthropic. This individual contributor role involves driving co-build strategies through deeper integrations, influencing Elastic's product roadmap, building prototypes, and shaping go-to-market content. The goal is to help customers leverage frontier intelligence with unstructured data by positioning Elasticsearch as the retrieval layer for AI agents. You will be responsible for building, managing, and owning technical relationships end-to-end, bringing both technical depth and practical experience to the role.

$184k - $291k

Anthropic

Reinforcement learning is crucial for training AI models to reason, write code, and act autonomously. At scale, this process involves a demanding distributed system where training, sampling, and environment execution run concurrently across a large fleet of accelerators and hosts. This system must continuously exchange data and maintain progress despite hardware failures, shifting loads, and evolving research. The efficiency of this system directly impacts learning outcomes and the speed of research iteration. As a Research Engineer on the Distributed Systems team within RL Engineering, you will focus on the most critical bottlenecks within this system. This could involve areas like scheduling, data movement, sandboxed environment execution, storage, networking, fault tolerance, autoscaling, or observability. The role seeks generalist engineers capable of reasoning from first principles across different system layers and prioritizing impactful problems over familiar ones. The ideal candidate will have experience building and operating large distributed systems, a commitment to detail, and a desire to apply their expertise to a complex, heterogeneous, and rapidly changing workload.

$500k - $850k

Datadog AI Research (DAIR) is seeking a Research Scientist to partner with Research Engineers on fundamental research problems. The role involves translating research advances into products by collaborating with Datadog's product and engineering teams. The team focuses on high-risk, high-reward problems in cloud observability and security, building on existing AI-powered solutions. The research areas include developing multimodal foundation models for understanding distributed systems and training autonomous agents for observability tasks like incident response and code repair.

$320k - $400k

Datadog is seeking a customer-focused, deeply technical Distinguished Architect to join our Product Solutions Architecture team. In this role, you will act as a technical multiplier for leading AI labs and AI-native companies, bridging the gap between their infrastructure aspirations and Datadog’s technology roadmap. You will ensure our platform natively solves the unique observability challenges of training and deploying foundational models at scale. We operate as a hybrid workplace to foster collaboration and creativity while ensuring work-life harmony.

$330k - $440k

The Agentic Interfaces team at Datadog is seeking a Staff Applied Scientist to lead the evaluation strategy for AI agent integrations. This role focuses on defining and building the measurement systems that ensure AI agents interacting with Datadog's observability, security, and software delivery data are continuously improving. You will be responsible for establishing metrics that cover answer quality, tool selection accuracy, retrieval relevance, latency, and cost, and will partner with AI engineers to implement these systems. This is an opportunity to tackle open research questions in agent-data interaction, such as evaluating non-deterministic trajectories, scoring tool selection in large catalogs, and building scalable measurement systems that benefit both first-party and third-party agents.

$276k - $345k

Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research. This team focuses on developing tools for optimizing efficiency and resiliency of AI workloads, including pre-training, post-training, and inference. Our objective is to deliver a stable, scalable environment for AI researchers, providing them with the necessary resources and scale to foster innovation. As a senior DGX Cloud AI Infrastructure software engineer, you will have the opportunity to work on innovative technologies that power the future of AI and data science and be part of a dynamic, diverse, and supportive team that values learning and growth.

$184k - $357k

The AI Platform team is building the shared runtime for all AI agents at MeridianLink, encompassing model gateway, orchestration, memory, and observability. This role focuses on the trust and explainability layer of this runtime, developing tracing, evaluation, and explanation capabilities. These features will enable engineers to understand multi-agent workflows and allow product teams to provide customers with appropriate explanations to build trust in agent outputs. This is a hands-on engineering role where you will write code for tracing agent actions, adopt and extend open-source frameworks for explainability and observability, and build primitives for surfacing explanations to end-users. You will work closely with a Staff engineer team lead and architects who will support your growth in this area.

$104k - $178k