Distinguished Architect, AI
$330k - $440k • New York, New York, USA; San Francisco, California, USA
Posted 18d ago
Job Location
New York, New York, USA; San Francisco, California, USA
Tech Stack
Remote Work Policy
On-site
Categories
Applied AI Engineer
About the job
Datadog is seeking a customer-focused, deeply technical Distinguished Architect to join our Product Solutions Architecture team. In this role, you will act as a technical multiplier for leading AI labs and AI-native companies, bridging the gap between their infrastructure aspirations and Datadog’s technology roadmap. You will ensure our platform natively solves the unique observability challenges of training and deploying foundational models at scale. We operate as a hybrid workplace to foster collaboration and creativity while ensuring work-life harmony.
Responsibilities
- Demonstrate thought leadership in the AI/LLM space and influence key decision makers.
- Strategically partner with technical leaders to guide them on AI/LLM best practices and emerging trends.
- Lead high-level technical and architectural conversations around AI adoption.
- Conduct deep-dive architecture reviews and design engagements with customer teams.
- Identify emerging AI-native technology shifts and feed them back to Product Management.
- Co-create custom observability integrations and solutions.
- Collaborate with internal teams to provide technical resources to a broad audience.
- Assist leadership in recruiting and hiring top talent for technical teams.
Requirements
- 10+ years of experience with at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure.
- Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks.
- Ability to think long term and creatively about technical and business challenges.
- Proven experience interacting with and influencing elite individual contributors, research scientists, and technical founders.
- Strong hands-on credibility and ability to whiteboard architectural solutions.
- Strong understanding of AI/LLM Ops and LLM Observability (LLMO) best practices and challenges.
- Excellent customer-facing presentation skills for large audiences and executives.
- Excellent verbal and written communication skills, linking product functionality to business objectives.
- Ability to travel up to 50% of the time.
- Bachelor’s degree in engineering or related field; Master’s degree preferred.
Benefits
- Best-in-breed onboarding
- Generous global benefits
- Intra-departmental mentor and buddy program
- New hire stock equity (RSUs)
- Employee stock purchase plan (ESPP)
- Continuous professional development, product training, and career pathing
- Inclusive company culture
- Healthcare, dental, parental planning, and mental health benefits
- 401(k) plan and match
- Paid time off
- Fitness reimbursements
- Discounted employee stock purchase plan