Staff GenAI Engineer - Application Performance Monitoring (APM)

$234k - $234k • New York, New York, USA

Posted 18d ago

Remote Work Policy

On-site

Categories

Applied AI Engineer

About the job

Datadog's Application Performance Monitoring (APM) team is seeking a Staff Software Engineer with deep experience in GenAI/ML to join them. The APM product offers in-depth visibility into applications, helping users pinpoint performance issues, troubleshoot problems, and optimize services. This role will focus on agentic workflows, leading efforts to design, train, evaluate, and deploy GenAI/ML models at scale. The ideal candidate is a product-minded ML engineer with strong technical expertise, excellent communication skills, and a history of driving impactful initiatives from start to finish. Datadog operates as a hybrid workplace, valuing office culture while supporting work-life harmony.

Responsibilities

  • Act as a technical leader within the APM organization, driving GenAI/machine learning projects from concept to production.
  • Build and benchmark GenAI/ML models using state-of-the-art techniques.
  • Collaborate with cross-functional teams to build automated investigation and triaging tools.
  • Influence product direction by bringing a strong product mindset to your work, always advocating for the end user.
  • Guide teams through ambiguity, scaling challenges, and evolving requirements with clear technical direction.
  • Actively mentor engineers and influence engineering culture through leadership in design reviews, technical talks, and working groups.

Requirements

  • BS/MS/PhD in a scientific field or equivalent experience.
  • 10+ years of relevant engineering experience, including experience as a technical lead.
  • Proven track record of leading large-scale GenAI/ML initiatives in a product-driven environment.
  • Significant experience in model deployment, development, training, fine-tuning, or evaluation.
  • Ability to drive initiatives across cross-functional teams and solve ambiguous challenges.

Benefits

  • Opportunity to build tools for software engineers and use those tools to accelerate development.

About Datadog

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.