AI Engineering Jobs in New York

ClickHouse

ClickHouse is a rapidly growing cloud company specializing in real-time analytics, data warehousing, observability, and AI workloads. The AI/ML Engineering team is responsible for building and operating the company's AI and machine learning products end-to-end, including the Agentic Data Stack, AI Functions, and in-console copilot. We are seeking experienced software engineers to design, build, and operate these cutting-edge AI products, making ClickHouse the platform of choice for agents and data scientists.

$150k - $238k

Datadog

Datadog AI Research (DAIR) is seeking a Staff Research Scientist to lead research in post-training and autonomous agents. This hands-on role involves advancing reinforcement learning, simulated environments, synthetic data generation, and evaluation methods for agents operating in complex systems. You will define the technical direction for research programs, elevate the skills of your colleagues, and collaborate with product and engineering teams to integrate research breakthroughs into Datadog's offerings.

$320k - $400k

Lightning AI is seeking an experienced Senior GPU & Compute Infrastructure Engineer to join their Infrastructure Engineering team. This role focuses on bringing up, validating, and operating large-scale bare-metal compute infrastructure, with a strong emphasis on GPU-enabled systems. You will work at the intersection of hardware, systems, and software, owning system diagnostics, validation, automation development, reliability improvements, and ensuring clusters are ready for demanding AI/ML and HPC workloads. The position involves GPU and system-level qualification, running validation environments and test clusters, and enhancing tooling and workflows for infrastructure bring-up at scale, including managing image pipelines and provisioning systems for consistency, performance, and reliability.

$180k - $220k

Datadog

As a Staff Research Scientist within Datadog AI Research (DAIR), you will drive research in foundation models and world models as a hands-on individual contributor. You will advance large-scale pre-training and multimodal learning across the diverse signals generated by distributed systems, including metrics, traces, logs, topology, and events. You will set the technical direction for ambitious research programs, raise the technical bar for the researchers and research engineers around you, and collaborate with Datadog's product and engineering teams to translate research advances into products.

$320k - $400k

Percepta

Percepta is seeking an AI Infrastructure Engineer to take ownership of the infrastructure, deployment, and operational reliability for Percepta's AI systems, including autonomous agents. This role involves hardening existing infrastructure, strengthening deployment pipelines, and defining new SRE practices for operating autonomous systems. You will be instrumental in bridging the gap between AI research and production, contributing to the foundational decisions that shape the future of agentic infrastructure.

$180k - $400k

Anthropic

Anthropic is building AI systems that are safe, beneficial, and transformative, with the mission to develop AI that benefits humanity. This role focuses on applying Claude to scientists and engineers working on hard problems in energy, materials, hardware design, and other physical-world fields. The team builds the necessary software, including agent harnesses, integrations, evaluations, and working processes, to turn a partner's problem into something Claude can make progress on and validate. This is an engineering role where you will work closely with domain experts, become proficient in using Claude for their specific fields, and prototype quickly. The primary focus is on building and hardening systems to make this work repeatable, rather than just configuring existing products. A science or engineering background is beneficial, but the ability to earn the trust of expert researchers, translate fuzzy problems into concrete and verifiable tasks, and ship solutions is paramount.

$405k - $485k

Invisible Technologies is seeking a Research Engineer to join its research organization, focusing on reinforcement learning, evaluation methodology, benchmarks, and RL environments for frontier labs and enterprise clients. This role involves defining how frontier models are measured, with direct influence over the methodology and its implementation. You will translate research questions into practical scoring frameworks, evaluation architectures, or environment designs, and then build the production systems to run them. This is a hands-on role for someone who wants to design the approach and write the code to prove it out, with reporting lines varying by experience level.

Salary not listed

Our Consumer Bank AI Modeling team develops advanced analytics and machine learning solutions that inform high-impact decisions across field workforce effectiveness, customer engagement, and banker-led growth. As an Applied AI Modeling Senior Associate, you will build and deploy advanced AI/ML models that measurably improve banker sales effectiveness and customer outcomes. Your models will help bankers deliver the right outreach at the right time to our customers, driving deposit growth, increasing customer retention, and strengthening relationships. You will operate in a highly governed environment and partner closely with product, UX, operations, and technology teams to translate modeling innovation into field-ready tools that bankers trust and adopt.

Salary not listed

Hebbia is seeking a Front-End Engineer to join the Agents team, focusing on building the user interface for universal knowledge capture. This role involves creating simple, delightful experiences for users to direct long-running agents, review citations, and iterate on key deliverables. You will translate new agentic capabilities from the research team into polished web and iOS interfaces. Engineers are empowered to own features end-to-end, including building necessary backend components like new endpoints, streaming APIs, or custom tools. The position requires deep expertise in modern web front-end engineering, strong product sense, and comfort with backend development when needed. Experience with iOS development is highly valued as the team expands its mobile presence. You will collaborate closely with applied researchers and infrastructure engineers, understanding the full system from model calls to UI.

$160k - $300k

Credal.ai

Credal is seeking a founding web full-stack software engineer to help build a scalable, performant architecture while maintaining industry-leading security. This role involves owning aspects of stability, scalability, and security, ensuring reliable syncing of billions of records, and contributing to architecture and code quality. You will engage directly with customers to solve complex problems, mentor junior engineers, and take end-to-end ownership of core products. The ideal candidate is a versatile software engineer comfortable across the full stack, excited about Agentic AI/LLM applications, and possesses strong software engineering fundamentals.

$190k - $250k

Percepta

Percepta is transforming critical institutions with applied AI, embedding with industry-leading customers to drive AI transformation. We bring together forward-deployed expertise in engineering, product, and research, along with our in-house toolkit for rapidly deploying agentic workflows and strategic partnerships. As a Research Scientist - Reinforcement Learning, you will work at the intersection of RL research and real-world deployment, advancing decision-making capabilities for critical industries. You will collaborate closely with Embedded Product Managers and engineers to ensure our solutions transform how companies operate.

$200k - $400k

Faire is a technology wholesale platform connecting independent retailers globally. We are seeking a Staff Engineer to own and evolve our data plumbing, ensuring data is accessible, accurate, and queryable for various teams including Product Engineering, Data Science, and Machine Learning. This hands-on role involves designing and building the next generation of our data ingestion and processing systems, and serving as the go-to expert for data movement at Faire.

$247k - $339k

Tennr

Tennr is seeking a high-agency Senior Backend Engineer to connect advanced ML research with practical product delivery. You will architect and develop agentic workflows designed to tackle complex healthcare processes, addressing infrastructure, workflow, and user experience challenges within the U.S. healthcare system. This role involves constructing data pipelines, evaluation frameworks, and scalable, production-ready agentic systems. You will be tasked with identifying and implementing the most suitable tools and models for each specific workflow, ensuring optimal technology utilization.

$190k - $215k

OpenAI

The Applied AI Engineering team is responsible for the safe and effective deployment of generative AI applications for developers and enterprises. As an Applied AI Engineer, you will work with industry-leading technology companies to integrate new AI capabilities into their products. This role involves partnering directly with experienced product and engineering teams to transform frontier model capabilities into new features and agentic experiences, combining rapid experimentation with the demands of established products. You will take ambitious ideas from use-case selection and architecture through prototyping, evaluation, production launch, and scale, writing and debugging code, building evaluation systems, and resolving complex integrations. Success is measured by production systems, sustained adoption, and meaningful customer impact.

$251k - $278k

Datadog

The Agentic Interfaces team at Datadog is seeking a Staff Applied Scientist to lead the evaluation strategy for AI agent integrations. This role focuses on defining and building the measurement systems that ensure AI agents interacting with Datadog's observability, security, and software delivery data are continuously improving. You will be responsible for establishing metrics that cover answer quality, tool selection accuracy, retrieval relevance, latency, and cost, and will partner with AI engineers to implement these systems. This is an opportunity to tackle open research questions in agent-data interaction, such as evaluating non-deterministic trajectories, scoring tool selection in large catalogs, and building scalable measurement systems that benefit both first-party and third-party agents.

$276k - $345k

Datadog

The Internal Product Analytics (IPA) team serves as the analytics backbone for Datadog's Product organization, providing PMs and leadership with the data, tooling, platform, and analysis necessary for informed decision-making. The team is responsible for recurring analytical tasks and developing AI-first workflows to enhance the speed and consistency of analysis across the organization. As the Manager of IPA, you will lead a team of data analysts, collaborate closely with Product Managers, and partner with platform engineering teams. Your role will involve setting the strategic direction for team analysis, AI-first tooling development, and cross-functional partnerships, focusing on transforming complex data and open questions into clear, actionable insights.

$160k - $200k

Datadog

Code Intelligence is at the intersection of agentic engineering and product, running agents against real customer source code in production. This role offers the opportunity to lead an AI-native team in a business-critical growth area, providing high visibility and leverage within the fastest-growing segment of the AI agent space. Datadog operates as a hybrid workplace, valuing office culture for collaboration and creativity while ensuring employees can achieve work-life harmony.

$192k - $240k

Datadog

Datadog is seeking a customer-focused, deeply technical Distinguished Architect to join our Product Solutions Architecture team. In this role, you will act as a technical multiplier for leading AI labs and AI-native companies, bridging the gap between their infrastructure aspirations and Datadog’s technology roadmap. You will ensure our platform natively solves the unique observability challenges of training and deploying foundational models at scale. We operate as a hybrid workplace to foster collaboration and creativity while ensuring work-life harmony.

$330k - $440k

Datadog

Datadog AI Research (DAIR) is seeking a Research Scientist to partner with Research Engineers on fundamental research problems. The role involves translating research advances into products by collaborating with Datadog's product and engineering teams. The team focuses on high-risk, high-reward problems in cloud observability and security, building on existing AI-powered solutions. The research areas include developing multimodal foundation models for understanding distributed systems and training autonomous agents for observability tasks like incident response and code repair.

$320k - $400k

Mirage is seeking an ML Engineer to push the boundaries of large language models for multimodal creative tasks. You'll develop new approaches for building and extending agentic systems that understand and operate over complex, real-world data, particularly video. This role focuses on advancing agent capabilities, improving reasoning and control, and enabling new forms of interaction between language models and time-based media.

$175k - $300k

Mirage is seeking an ML Engineer to build and scale the systems powering their video generation models. This role sits at the intersection of research and systems engineering, focusing on making advanced models faster, more efficient, and capable of ultra-low latency, real-time generation. You will work on novel modeling approaches, training objectives, scaling strategies, and inference optimization and efficiency to bring cutting-edge models into production.

$175k - $300k

Databricks

<h1>Staff Software Engineer - Agent Quality</h1> <h4>P-1567</h4> <p>At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by building and running the world’s best data and AI platform so our customers can focus on the high-value challenges that are central to their own missions.</p> <p>The Databricks AI Research organization is pushing the frontier of next-generation enterprise AI. We believe a company's data is its greatest competitive advantage, and we're building the models and agents that unlock it. Our work spans the full stack, from model training to advanced multi-agent systems.&nbsp;</p> <p>As a Staff Software Engineer - Agent Quality, you will be a founding member of a new team focused on evaluating and continuously improving Databricks' AI Agents. You will design and scale the infrastructure, tooling, and developer workflows that let researchers and engineers evaluate agents rigorously — driving a flywheel where evaluation results feed directly back into agent improvement across the full lifecycle, from development and training to production.</p> <h2>The impact you will have</h2> <ul> <li>Stand up the foundational evaluation infrastructure for Genie Agents, enabling rigorous benchmarking, regression detection, and quality measurement across research and product teams.</li> <li>Build the flywheel that connects evaluation results back into agent improvement — closing the loop between production signals, training, and iterative development.</li> <li>Shape the long-term technical direction for agent quality infrastructure, with real influence over how Databricks measures and improves its first-party agents and agent development platform.</li> <li>Help shape the long-term technical direction for agent quality infrastructure as Databricks expands its first-party agents and agent development platform.</li> </ul> <h2>What we look for</h2> <ul> <li>6+ years industry experience building software systems</li> <li>Strong Python programming skills, with experience building production or research infrastructure</li> <li>Experience building or operating distributed systems, data pipelines, or large-scale infrastructure with a focus on reliability, correctness, and operational maturity</li> <li>Ability to design pragmatic but rigorous systems that produce trustworthy, reproducible signals for complex applications</li> <li>Comfort working across ambiguous research and product boundaries, and partnering with both researchers and engineers to turn ideas into robust internal platforms</li> <li>A high bar for technical quality, strong ownership, and the ability to influence roadmap and execution across multiple teams</li> </ul> <h2>Nice to have</h2> <ul> <li>Experience with devtools, CI/CD platforms, testing frameworks, observability tooling, or benchmarking infrastructure</li> <li>Familiarity with how LLM or agent quality is measured — whether through evals, experimentation platforms, or production monitoring</li> </ul><div class="content-pay-transparency"><div class="pay-input"><div class="description"><p>&nbsp;</p> <p><strong>Pay Range Transparency</strong></p> <p><span style="font-weight: 400; font-size: 14px;">Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles.&nbsp; Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page <a href="https://www.databricks.com/sites/default/files/2024-08/us-pay-zone-mapping.pdf">here</a>.<br></span></p> <p>&nbsp;</p></div><div class="title">Local Pay Range</div><div class="pay-range"><span>$200,000</span><span class="divider">&mdash;</span><span>$265,000 USD</span></div></div></div><div class="content-conclusion"><p><strong>About Databricks</strong></p> <p><span style="font-family: arial, sans-serif;">Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&amp;T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on <a href="https://www.linkedin.com/company/databricks">LinkedIn</a>, <a href="https://x.com/databricks">X</a>, <a href="https://www.youtube.com/@Databricks">YouTube</a>, and <a href="https://www.instagram.com/databricksinc/?hl=en">Instagram</a>.<br><br><strong>Benefits<br><br></strong></span>At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click <a href="https://docs.google.com/document/d/154un3e8Xav4BceOSlcYFZRGEuQI54xMxVydRwQn54eQ/edit?usp=sharing">here</a>.<br><br></p> <p><strong>Our Commitment to Diversity and Inclusion</strong></p> <p>At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.</p> <p><strong>Compliance</strong></p> <p><strong><span style="font-weight: 400;">If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.</span></strong></p></div>

$200k - $265k

Ramp

Ramp is seeking a Machine Learning Engineer to lead the future of fraud machine learning. In this role, you will build core machine learning models, design data architectures, and set strategic roadmaps to mitigate fraud-related threats while minimizing friction for legitimate users. You will partner closely with product and engineering teams on model design, implementation, execution, and analysis. This is an opportunity to build systems that directly shape how companies move and manage billions.

$200k - $330k

Sierra

Sierra is a leading platform for customer-facing AI agents, partnering with major global brands to transform customer service and business growth. We are an in-person company based in San Francisco with a culture guided by values of Trust, Customer Obsession, Craftsmanship, Intensity, and a commitment to balancing family. Our co-founders have extensive experience from leading tech companies like Salesforce, Facebook, and Google. The Healthcare team is focused on transforming the patient experience across the healthcare system, making care more accessible, human, and affordable through AI agents that handle sensitive conversations with empathy and compliance.

$180k - $390k