AI Engineering Jobs in New York

JPMorgan Chase is seeking a Lead Software Engineer for their Asset and Wealth Management- Analytics & Applied AI Team. This role is integral to an agile team focused on enhancing, building, and delivering secure, stable, and scalable technology products. You will be a core technical contributor, responsible for developing critical technology solutions across various business functions to meet firm objectives. The ideal candidate is passionate about solving business problems through innovation, analytics, and an AI-first engineering mindset, focusing on building reusable, governed analytical data products and accelerating regulatory and CEO-priority analytics. You will lead an AI-first transformation of data engineering and analytics by productizing the data product lifecycle and building human-in-the-loop autonomous agents to reduce manual effort, improve auditability, and enable self-service consumption on the strategic data mesh, while also owning the modernization of this mesh.

Salary not listed

As a Staff Data Engineer at Capital One, you will be a leading technical expert contributing to the future of data platforms and banking in the cloud. You will collaborate with data engineers, data scientists, machine learning experts, and product managers to devise scalable and reusable data solutions for complex problems. Your role involves driving innovation, optimizing business outcomes, and delivering strong data and technology solutions. You will promote engineering excellence, mentor junior engineers, and actively recruit talent to build our community. You will operate as a trusted advisor, sharing knowledge through communications, code samples, and blog posts, specializing in a particular subject area while impacting the organization broadly.

$269k - $307k

As an Applied ML and Generative AI leader within the Corporate Technology team, you will develop applications and provide tech support for all corporate functions across the network. You will operate as a hands-on leader responsible for designing, building, and running production-grade ML and Generative AI services, while setting technical direction that scales across multiple workstreams. You will remain close to the code and architecture decisions, establish delivery and engineering standards, and ensure solutions meet enterprise expectations for security, stability, and operational rigor. A core requirement is stakeholder partnership: you will routinely explain what is being built, why it matters, and how it will perform in production to both technical and non-technical audiences, enabling informed decisions and clear delivery alignment.

Salary not listed

As a Full-stack Software Engineer 4 on the Associate Experience team, you will be a key contributor to designing and building the agentic orchestration layer. This foundational framework will enable AI agents to be composed, sequenced, and operated as a unified associate experience for marketing initiatives. This is a high-impact, individual contributor role where your architectural decisions will significantly shape future marketing team operations.

$179k - $205k

As the Applied ML and Generative Lead within J.P. Morgan, you will operate as a hands-on engineering leader responsible for designing, building, and running production-grade ML and Generative AI services, while setting technical direction that scales across multiple workstreams. You will remain close to the code and architecture decisions, establish delivery and engineering standards, and ensure solutions meet enterprise expectations for security, stability, and operational rigor. A core requirement is stakeholder partnership: you will routinely explain what is being built, why it matters, and how it will perform in production to both technical and non-technical audiences, enabling informed decisions and clear delivery alignment.

Salary not listed

Tennr

Tennr is seeking a high-agency Senior Backend Engineer to connect advanced ML research with practical product delivery. You will architect and develop agentic workflows designed to tackle complex healthcare processes, addressing infrastructure, workflow, and user experience challenges within the U.S. healthcare system. This role involves constructing data pipelines, evaluation frameworks, and scalable, production-ready agentic systems. You will be tasked with identifying and implementing the most suitable tools and models for each specific workflow, ensuring optimal technology utilization.

$190k - $215k

OpenAI

The Applied AI Engineering team is responsible for the safe and effective deployment of generative AI applications for developers and enterprises. As an Applied AI Engineer, you will work with industry-leading technology companies to integrate new AI capabilities into their products. This role involves partnering directly with experienced product and engineering teams to transform frontier model capabilities into new features and agentic experiences, combining rapid experimentation with the demands of established products. You will take ambitious ideas from use-case selection and architecture through prototyping, evaluation, production launch, and scale, writing and debugging code, building evaluation systems, and resolving complex integrations. Success is measured by production systems, sustained adoption, and meaningful customer impact.

$251k - $278k

Datadog

The Agentic Interfaces team at Datadog is seeking a Staff Applied Scientist to lead the evaluation strategy for AI agent integrations. This role focuses on defining and building the measurement systems that ensure AI agents interacting with Datadog's observability, security, and software delivery data are continuously improving. You will be responsible for establishing metrics that cover answer quality, tool selection accuracy, retrieval relevance, latency, and cost, and will partner with AI engineers to implement these systems. This is an opportunity to tackle open research questions in agent-data interaction, such as evaluating non-deterministic trajectories, scoring tool selection in large catalogs, and building scalable measurement systems that benefit both first-party and third-party agents.

$276k - $345k

Datadog

The Internal Product Analytics (IPA) team serves as the analytics backbone for Datadog's Product organization, providing PMs and leadership with the data, tooling, platform, and analysis necessary for informed decision-making. The team is responsible for recurring analytical tasks and developing AI-first workflows to enhance the speed and consistency of analysis across the organization. As the Manager of IPA, you will lead a team of data analysts, collaborate closely with Product Managers, and partner with platform engineering teams. Your role will involve setting the strategic direction for team analysis, AI-first tooling development, and cross-functional partnerships, focusing on transforming complex data and open questions into clear, actionable insights.

$160k - $200k

Datadog

Code Intelligence is at the intersection of agentic engineering and product, running agents against real customer source code in production. This role offers the opportunity to lead an AI-native team in a business-critical growth area, providing high visibility and leverage within the fastest-growing segment of the AI agent space. Datadog operates as a hybrid workplace, valuing office culture for collaboration and creativity while ensuring employees can achieve work-life harmony.

$192k - $240k

Datadog

Datadog is seeking a customer-focused, deeply technical Distinguished Architect to join our Product Solutions Architecture team. In this role, you will act as a technical multiplier for leading AI labs and AI-native companies, bridging the gap between their infrastructure aspirations and Datadog’s technology roadmap. You will ensure our platform natively solves the unique observability challenges of training and deploying foundational models at scale. We operate as a hybrid workplace to foster collaboration and creativity while ensuring work-life harmony.

$330k - $440k

Datadog

Datadog AI Research (DAIR) is seeking a Research Scientist to partner with Research Engineers on fundamental research problems. The role involves translating research advances into products by collaborating with Datadog's product and engineering teams. The team focuses on high-risk, high-reward problems in cloud observability and security, building on existing AI-powered solutions. The research areas include developing multimodal foundation models for understanding distributed systems and training autonomous agents for observability tasks like incident response and code repair.

$320k - $400k

Mirage is seeking an ML Engineer to push the boundaries of large language models for multimodal creative tasks. You'll develop new approaches for building and extending agentic systems that understand and operate over complex, real-world data, particularly video. This role focuses on advancing agent capabilities, improving reasoning and control, and enabling new forms of interaction between language models and time-based media.

$175k - $300k

Mirage is seeking an ML Engineer to build and scale the systems powering their video generation models. This role sits at the intersection of research and systems engineering, focusing on making advanced models faster, more efficient, and capable of ultra-low latency, real-time generation. You will work on novel modeling approaches, training objectives, scaling strategies, and inference optimization and efficiency to bring cutting-edge models into production.

$175k - $300k

Our Consumer Bank AI Modeling team develops advanced analytics and machine learning solutions that inform high-impact decisions across field workforce effectiveness, customer engagement, and banker-led growth. As an Applied AI Modeling Vice President in this team, you will build and deploy advanced AI/ML models that measurably improve banker sales effectiveness and customer outcomes. Your models will help bankers deliver the right outreach at the right time to our customers, driving deposit growth, increasing customer retention, and strengthening relationships. You will operate in a highly governed environment and partner closely with product, UX, operations, and technology teams to translate modeling innovation into field-ready tools that bankers trust and adopt.

Salary not listed

As a Data Scientist on the Commercial Bank Applied AI team, you will be at the forefront of embedding Generative AI directly into core business processes. You will specialize in building enterprise-grade architectures using advanced techniques such as Multi-Agent Systems, Advanced RAG, Context Engineering, and Tool-Calling Frameworks. This role is ideal for someone deeply passionate about the practical applications of Generative AI with hands-on experience in machine learning and AI, gained through professional industry work or rigorous academic research. You will partner with a cross-functional team to deliver Generative AI solutions, leveraging a broad stack of technologies to build Multi-Agent systems and advanced RAG pipelines over vast volumes of data. You will build Generative AI models and pipelines through all phases of development, from context engineering through fine-tuning, evaluation, validation, and deployment, translating complex work into tangible business goals.

$136k - $155k

The Commercial Bank Applied AI team is at the forefront of embedding Generative AI directly into core business processes, specializing in building enterprise-grade architectures using advanced techniques such as Multi-Agent Systems, Advanced RAG, and Context Engineering. As a Data Scientist on this team, you will partner with a cross-functional group of experts to deliver Generative AI solutions, leveraging a broad stack of technologies including Python, LangChain, AWS, and Vector Databases to build Multi-Agent systems and advanced RAG pipelines over vast volumes of data. You will be involved in all phases of Generative AI model and pipeline development, from context engineering through fine-tuning, evaluation, validation, and deployment, translating complex work into tangible business goals.

$162k - $185k

Databricks

<h1>Staff Software Engineer - Agent Quality</h1> <h4>P-1567</h4> <p>At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by building and running the world’s best data and AI platform so our customers can focus on the high-value challenges that are central to their own missions.</p> <p>The Databricks AI Research organization is pushing the frontier of next-generation enterprise AI. We believe a company's data is its greatest competitive advantage, and we're building the models and agents that unlock it. Our work spans the full stack, from model training to advanced multi-agent systems.&nbsp;</p> <p>As a Staff Software Engineer - Agent Quality, you will be a founding member of a new team focused on evaluating and continuously improving Databricks' AI Agents. You will design and scale the infrastructure, tooling, and developer workflows that let researchers and engineers evaluate agents rigorously — driving a flywheel where evaluation results feed directly back into agent improvement across the full lifecycle, from development and training to production.</p> <h2>The impact you will have</h2> <ul> <li>Stand up the foundational evaluation infrastructure for Genie Agents, enabling rigorous benchmarking, regression detection, and quality measurement across research and product teams.</li> <li>Build the flywheel that connects evaluation results back into agent improvement — closing the loop between production signals, training, and iterative development.</li> <li>Shape the long-term technical direction for agent quality infrastructure, with real influence over how Databricks measures and improves its first-party agents and agent development platform.</li> <li>Help shape the long-term technical direction for agent quality infrastructure as Databricks expands its first-party agents and agent development platform.</li> </ul> <h2>What we look for</h2> <ul> <li>6+ years industry experience building software systems</li> <li>Strong Python programming skills, with experience building production or research infrastructure</li> <li>Experience building or operating distributed systems, data pipelines, or large-scale infrastructure with a focus on reliability, correctness, and operational maturity</li> <li>Ability to design pragmatic but rigorous systems that produce trustworthy, reproducible signals for complex applications</li> <li>Comfort working across ambiguous research and product boundaries, and partnering with both researchers and engineers to turn ideas into robust internal platforms</li> <li>A high bar for technical quality, strong ownership, and the ability to influence roadmap and execution across multiple teams</li> </ul> <h2>Nice to have</h2> <ul> <li>Experience with devtools, CI/CD platforms, testing frameworks, observability tooling, or benchmarking infrastructure</li> <li>Familiarity with how LLM or agent quality is measured — whether through evals, experimentation platforms, or production monitoring</li> </ul><div class="content-pay-transparency"><div class="pay-input"><div class="description"><p>&nbsp;</p> <p><strong>Pay Range Transparency</strong></p> <p><span style="font-weight: 400; font-size: 14px;">Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles.&nbsp; Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page <a href="https://www.databricks.com/sites/default/files/2024-08/us-pay-zone-mapping.pdf">here</a>.<br></span></p> <p>&nbsp;</p></div><div class="title">Local Pay Range</div><div class="pay-range"><span>$200,000</span><span class="divider">&mdash;</span><span>$265,000 USD</span></div></div></div><div class="content-conclusion"><p><strong>About Databricks</strong></p> <p><span style="font-family: arial, sans-serif;">Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&amp;T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on <a href="https://www.linkedin.com/company/databricks">LinkedIn</a>, <a href="https://x.com/databricks">X</a>, <a href="https://www.youtube.com/@Databricks">YouTube</a>, and <a href="https://www.instagram.com/databricksinc/?hl=en">Instagram</a>.<br><br><strong>Benefits<br><br></strong></span>At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click <a href="https://docs.google.com/document/d/154un3e8Xav4BceOSlcYFZRGEuQI54xMxVydRwQn54eQ/edit?usp=sharing">here</a>.<br><br></p> <p><strong>Our Commitment to Diversity and Inclusion</strong></p> <p>At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.</p> <p><strong>Compliance</strong></p> <p><strong><span style="font-weight: 400;">If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.</span></strong></p></div>

$200k - $265k

At Capital One, we are building responsible and reliable AI systems to transform banking. We are at the forefront of enterprises leveraging AI, using machine learning for real-time, personalized customer experiences. Our Intelligent Foundations and Experiences (IFX) team is central to this vision, advancing AI science and engineering to build and deploy proprietary solutions that deliver value to millions of customers. You will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses, working hand-in-hand with partners to enhance products with AI in responsible and scalable ways.

$197k - $225k

Capital One is seeking an AI Engineer to join the Intelligent Foundations and Experiences (IFX) team. This role involves partnering with cross-functional teams to deliver AI-powered products that enhance customer interactions and internal operations. You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, AI agents, similarity search, and model evaluation. The position requires inventing and implementing state-of-the-art foundation model optimization techniques to improve the performance of large-scale production AI systems, contributing to the technical vision and roadmap for foundational AI systems, and owning the end-to-end architecture for complex AI systems. You will also define and maintain service-level objectives for AI reliability, collaborate with infrastructure engineering to optimize GPU/TPU utilization, and lead technical reviews for new AI system deployments.

$197k - $225k

As a Senior Manager of Software Engineering at JPMorgan Chase, you will lead and mentor multiple technical teams focused on advancing financial technologies within the Commercial & Investment Bank - Payments (Data Analytics & Regulatory Compliance) Team. You will be responsible for designing and delivering secure, stable, and scalable technology products, driving critical technology solutions across various business functions to meet firm objectives. This role involves setting and scaling operating practices for AI-assisted engineering and SDLC automation, establishing measurable expectations, and ensuring the reuse of proven technology assets.

Salary not listed

Ramp

Ramp is seeking a Machine Learning Engineer to lead the future of fraud machine learning. In this role, you will build core machine learning models, design data architectures, and set strategic roadmaps to mitigate fraud-related threats while minimizing friction for legitimate users. You will partner closely with product and engineering teams on model design, implementation, execution, and analysis. This is an opportunity to build systems that directly shape how companies move and manage billions.

$200k - $330k

Sierra

Sierra is a leading platform for customer-facing AI agents, partnering with major global brands to transform customer service and business growth. We are an in-person company based in San Francisco with a culture guided by values of Trust, Customer Obsession, Craftsmanship, Intensity, and a commitment to balancing family. Our co-founders have extensive experience from leading tech companies like Salesforce, Facebook, and Google. The Healthcare team is focused on transforming the patient experience across the healthcare system, making care more accessible, human, and affordable through AI agents that handle sensitive conversations with empathy and compliance.

$180k - $390k

Capital One is seeking passionate Machine Learning Engineers to join their Intelligent Foundations and Experiences (IFX) team. In this role, you will be at the forefront of driving AI transformations and scaling production models across the company. You will collaborate with Product and Data Science teams to design, build, and deliver ML models that solve real-world business problems. This position involves working in a fast-paced, collaborative environment, leveraging cutting-edge open-source frameworks, advanced algorithms, and emerging technologies.

$215k - $246k