Evals Jobs

Salesforce is seeking a Senior AI Engineer to join the Agentforce Operations team, a high-velocity 'startup-within-Salesforce' focused on revolutionizing the public sector supply chain with an AI-powered platform. This role offers the unique opportunity to build a '0 to 1' product in a rapidly growing vertical, working alongside a founding team with deep startup roots but backed by the global scale of Salesforce. You will be instrumental in shaping both the product and the engineering team, partnering with product leaders and sector experts to deliver trusted AI systems for mission-critical public-sector workflows. The role involves building AI features tailored to public-sector customers, designing systems with security, compliance, reliability, and operational constraints at their core, and operating with wide autonomy to raise the bar for technical quality and mentorship.

$149k - $224k

Snorkel AI is seeking an early member for its ML & Research Engineering team to help build the data and environments behind high-performing frontier and agentic AI. You will be responsible for making the process of generating and evaluating frontier AI data faster, cheaper, and more rigorous using ML and AI. This role involves studying data generation and evaluation, forming and validating hypotheses with production data, and shipping scalable solutions. You will play a key part in shaping the direction, standards, and growth of the discipline.

$208k - $315k

HUD is building reliable, fair, and open infrastructure for AI data, aiming to make data valuable for creators and trustworthy for AI trainers. We are a growing team of researchers, engineers, and operators backed by significant VC funding. We are seeking a Research Manager to lead research focused on enhancing HUD's agent training data and evaluations for frontier models. This role involves guiding research engineers through complex projects, translating findings into scalable methods, and staying technically engaged while ensuring rigorous experimentation and impactful results. The ideal candidate will possess a deep understanding of model training dynamics, including how signals, data, and evaluation design influence outcomes.

$120k - $295k

Innodata is seeking a Research Scientist to lead the science of data for robotics foundation models. This role involves partnering directly with customers and frontier labs to define how data is designed, structured, and evaluated for next-generation AI systems in robotics. You will leverage scientific judgment to make high-leverage decisions about data capture, synthesis, representation, and evaluation, ensuring that the data collected and generated directly supports the development of robust and transferable AI models for manipulation, locomotion, vision-language-action, and world models.

$160k - $185k

The Model Capabilities team at Notion is responsible for maintaining Notion AI's model layer, ensuring it remains at the cutting edge. This involves integrating new frontier models as they become available, guaranteeing reliable and cost-effective inference at scale, and developing new AI capabilities that can be leveraged by other teams within Notion. The role is based in either San Francisco or New York City, with a hybrid work arrangement requiring in-office presence on Mondays, Tuesdays, and Thursdays.

$255k - $300k

This role is for experienced software engineers looking to build AI-powered products. You will own user-facing surfaces end-to-end, from interaction design and frontend development to application logic, APIs, data models, and the underlying search or model calls. The team continuously ships to production, with new engineers often having code in front of users within their first week. You will leverage AI, including agents and coding models, as primary tools to accelerate development and improve product quality, focusing on reliability, latency, and craft. This is a full-stack position that suits individuals who enjoy building and have the autonomy to do so, with a focus on turning ambiguous product ideas into working prototypes and iterating based on usage data and evaluations.

$180k - $270k

The Silicon Co-Design Group (SCG) is at the forefront of chip development, spanning architecture, design, marketing, operations, and productization across various markets including Datacenter, Gaming, Robotics, and Automotive. We are seeking a Senior Engineer to lead system validation, debug, and cross-functional alignment for critical silicon programs. This role is pivotal in ensuring product quality by identifying and resolving complex issues before they reach customers, and by building robust, AI-enabled validation capabilities. Your work will directly impact product success, escape rates, and customer confidence.

$168k - $311k

Anthropic

Anthropic's mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for users and society. The Vision team is seeking a research engineer to focus on visual and spatial reasoning as core capabilities for LLMs. This role involves owning the end-to-end process of creating training data and RL environments for visual knowledge work. You will identify tasks, build evaluations, design rewards, and scale data, combining applied research with hands-on data work. Collaboration with external vendors, pretraining, RL, and product teams is essential to ensure the environments built translate into real-world knowledge work capabilities.

$350k - $850k

Snorkel AI is seeking a leader to manage a portfolio of Coding Fellows who create high-quality technical content for training and evaluating AI systems. This people-first role focuses on the management layer across multiple projects, encompassing expectations, performance, support, development, and administration. While technical depth is necessary to understand and discuss Fellow work, the primary responsibility is people management rather than day-to-day technical leadership.

$175k - $250k

Distyl AI is an applied AI technology company that partners with ambitious institutions to rearchitect critical operations using frontier AI. We research and deploy technologies for AI-native operations, focusing on self-constructing systems, reliable AI execution, and products that transform mission-critical workflows. Our work impacts large-scale operations across various industries, including telecom, healthcare, insurance, and manufacturing. We are seeking AI Engineers who are hands-on builders and thrive in ambiguous problem spaces. This role involves designing, implementing, deploying, and iterating on end-to-end AI systems in close partnership with customers and subject matter experts. The focus is on making AI systems work reliably in production environments, with accountability for outcomes, rather than just building demos.

$150k - $250k

We are seeking a Staff/Senior Software Engineer to join our Agent Engineering team, focusing on the Helios project. This role involves building and strengthening the foundations of our agent runtime, enabling the creation of new agent-driven products. You will develop systems that allow agents to manage long-running work from assignment to completion, ensuring agent activity is visible, steerable, and connected to relevant projects, people, evidence, deadlines, and deliverables. Additionally, you will construct the framework for agents to safely interact with internal systems and external services, and connect agents to our retrieval and knowledge systems to ground their reasoning, memory, citations, and generated artifacts in authoritative evidence. A key part of this role is improving the evaluation and release discipline for agent behavior, traces, and simulations to enhance quality while controlling latency, cost, and risk.

As a Forward Deployed Engineer at Handshake AI Enterprise, you will embed directly within enterprise customer environments as part of a small, expert team. Your role involves deeply understanding each customer's business, including their workflows and bottlenecks, to translate this knowledge into production-grade AI agents that measurably transform their operations. This is a full-stack role where you will own the entire process from defining the solution, building and deploying agents, designing evaluations, and iterating until performance targets are met. Over time, you will develop genuine domain expertise in your customer's vertical, leveraging this knowledge to continuously improve AI solutions. This opportunity is ideal for individuals who have a proven track record of building AI applications that work in the real world and are eager to tackle high-stakes challenges with superior data and strong lab relationships.

$220k - $300k

Fieldguide is building a new state of trust for global commerce and capital markets by automating and streamlining the work of assurance and audit practitioners. The Foundation Agents team is responsible for the long-horizon agents that power the Fieldguide AI platform, working at the frontier of AI product development. This role involves focusing on agent knowledge, evaluations, and improving quality and reliability at scale for agents that perform real-world work.

$190k - $220k

CHAOS Industries is seeking a mission-oriented Applied AI Engineer to develop, integrate, and deploy AI/ML capabilities across its defense product lines. This role involves working with data scientists, software engineers, and product teams to conduct advanced AI research and translate it into reliable, real-world software, particularly for defense applications requiring extreme accuracy under challenging conditions. The ideal candidate possesses strong data science and software engineering fundamentals, a track record of technical excellence, and experience applying AI/ML to real products, with a preference for backgrounds in aerospace, defense, or similar mission-driven environments. Comfort with independent operation, rapid learning of new technical domains, cross-team collaboration, and moving prototypes to production with minimal oversight is essential.

$150k - $170k

Harvey is transforming legal and professional services by integrating frontier agentic AI with an enterprise-grade platform. This role offers a unique opportunity to contribute to a rapidly scaling company that is defining a new category in real-time. The team values decisiveness, simplicity, and a commitment to continuous improvement, seeking individuals who are driven to do their best work alongside like-minded colleagues. The future of professional services is being shaped at Harvey, and the company is just beginning its journey.

$231k - $340k

Harvey is transforming legal and professional services by integrating advanced agentic AI with an enterprise-grade platform. This role offers a unique opportunity to contribute to a rapidly scaling company that is defining a new category in real-time. The team values decisiveness, simplicity, and a commitment to continuous improvement, seeking individuals who are driven to do their best work alongside like-minded professionals. The future of professional services is being shaped at Harvey, and this is just the beginning.

$231k - $340k

Anthropic

As an Applied AI Research Engineer, you will explore the capabilities of Anthropic's models and products, validate them with real customers, and empower the Applied AI team to effectively sell and deliver these solutions. You will work closely with product teams to gain deep expertise on emerging capabilities and act as a crucial feedback loop, relaying field insights back to Product and Research to ensure future development aligns with customer needs. This role involves a blend of research, field expertise, and bridging the gap between customers and product development teams. You will need strong technical skills to push the boundaries of AI models, excellent communication abilities to explain complex features to various audiences, and the insight to translate field learnings into product improvements.

$300k - $400k

OpenAI

This role focuses on oversight and system-level mitigations to enable increasingly capable AI agents to operate safely and autonomously in real environments. The team prioritizes building oversight systems used in practice today, both internally and externally, and studies longer-term questions about how agent systems can be supervised, constrained, and corrected. We are looking for a safety-minded researcher or engineer who can reason rigorously about security boundaries and agent behavior, then build and test practical mitigations. A background in AI control or security is welcome but not required.

$380k - $500k

OpenAI

The Agent Safety team is dedicated to ensuring that advanced AI agents operate safely, make sound judgments, and align with user intentions. The mission is to minimize the risk of severe unintended consequences from increasingly capable AI agents while maintaining their effectiveness and autonomy. This involves creating training methods, environments, and data to teach agents better decision-making, building evaluation systems to identify emerging risks, and developing oversight mechanisms to reduce harmful actions.

$380k - $500k

As a Forward Deployed Engineer at Handshake AI Enterprise, you will embed directly within enterprise customer environments as part of a small, expert team. Your role will involve deeply understanding each customer's business, including their workflows and bottlenecks, to translate this knowledge into production-grade AI agents that measurably transform their operations. This is a full-stack ownership role, encompassing solution definition, agent building and deployment, evaluation design, and iterative performance improvement. You will develop into a genuine domain expert within your customer's vertical, leveraging this expertise to continuously enhance AI capabilities.

$155k - $170k