Evals Jobs

Turing is seeking Research Engineers to advance the understanding of frontier AI systems and develop practical innovations in data, algorithms, evaluation, and training. You will work at the intersection of research and engineering, investigating high-impact questions that improve real-world AI systems. You will design and run rigorous experiments, develop research-grade prototypes and tooling, and collaborate with Research, Engineering, Product, and Operations teams to translate promising ideas into scalable applications. This role offers the opportunity to contribute to both foundational research and applied AI development across synthetic and agentic data generation, reinforcement learning, post-training, model understanding, benchmarks, and evaluation.

$250k - $400k

Turing is at the forefront of accelerating superintelligence to drive economic progress. We partner with leading AI labs and enterprises to create high-quality datasets, reinforcement learning environments, and research benchmarks that enhance model capabilities in areas like software engineering, enterprise knowledge work, and advanced STEM reasoning. Our work spans both foundational research and applied AI development, focusing on synthetic and agentic data generation, reinforcement learning, post-training, model understanding, benchmarks, and evaluation. We aim to bridge the gap between cutting-edge research and real-world deployment, using deployment signals to refine data, evaluations, and models.

$250k - $400k

Turing builds large-scale datasets and reinforcement learning (RL) environments that power post-training for leading AI labs and enterprises. We create RL environments to evaluate and improve models on complex, long-range, multi-step workflows across high-value domains. We are seeking Research Engineers to advance our understanding of frontier AI systems and develop practical innovations in data, algorithms, evaluation, and training. You will work at the intersection of research and engineering, investigating high-impact questions that improve real-world AI systems. You will design and run rigorous experiments, develop research-grade prototypes and tooling, and collaborate with teams to translate promising ideas into scalable applications. This role offers the opportunity to contribute to both foundational research and applied AI development across synthetic and agentic data generation, reinforcement learning, post-training, model understanding, benchmarks, and evaluation.

$250k - $350k

Turing is seeking Research Engineers to advance our understanding of frontier AI systems and develop practical innovations in data, algorithms, evaluation, and training. You will work at the intersection of research and engineering, investigating high-impact questions that improve real-world AI systems. You will design and run rigorous experiments, develop research-grade prototypes and tooling, and collaborate with Research, Engineering, Product, and Operations teams to translate promising ideas into scalable applications. This role offers the opportunity to contribute to both foundational research and applied AI development across synthetic and agentic data generation, reinforcement learning, post-training, model understanding, benchmarks, and evaluation.

$250k - $350k

Turing is seeking Research Engineers to advance our understanding of frontier AI systems and develop practical innovations in data, algorithms, evaluation, and training. You will work at the intersection of research and engineering, investigating high-impact questions that improve real-world AI systems. You will design and run rigorous experiments, develop research-grade prototypes and tooling, and collaborate with Research, Engineering, Product, and Operations teams to translate promising ideas into scalable applications. This role offers the opportunity to contribute to both foundational research and applied AI development across synthetic and agentic data generation, reinforcement learning, post-training, model understanding, benchmarks, and evaluation.

$250k - $350k

Momentic is seeking a hands-on AI Engineer to join their engineering team and collaborate closely with the CTO. This role focuses on enhancing the AI models and agents that power Momentic's AI-native testing platform. You will be instrumental in fine-tuning models, developing robust evaluation strategies, and transforming production data into more reliable and efficient AI agents. Your work will have a direct and significant impact, as Momentic processes over a million tests daily and billions of tokens per hour.

$175k - $250k

Faire is a technology wholesale platform connecting independent retailers with global entrepreneurs. We leverage tech, data, and machine learning to empower local businesses. The Applied AI/ML Science team builds and maintains models that power the marketplace, including shipping and delivery estimates. This role focuses on developing models that understand products from images and text to improve predictions and enhance retailer confidence, ultimately helping brands sell more on Faire.

Glean is seeking a Tech Lead Manager of AI Evaluations to lead a team of applied AI scientists and engineers. This role is crucial for developing the evaluation strategy and platform that ensures Glean ships reliable and delightful AI experiences. You will integrate evaluation into the development and operation of models, harnesses, assistants, and agents. The position involves translating AI/ML research into robust evaluation systems, building scalable infrastructure for evaluations, and collaborating with R&D, product, and marketing teams to improve products based on evaluation outcomes.

$250k - $350k

Glean is seeking an AI Engineer focused on Quality and Post-Training to enhance their Work AI platform. This role is crucial for improving the reliability and usefulness of AI agents by focusing on measurement and quality improvements. You will work at the intersection of applied research, quality assurance, and product engineering to refine Glean's AI assistants and autonomous agents, ensuring they can reason, plan, and act effectively across complex workflows. The position involves optimizing the entire AI stack, including agent harnesses, model routing, prompts, and retrieval, while balancing quality with performance and cost.

$200k - $280k

The bottleneck in building reliable, useful AI is no longer writing code, but defining and measuring what good looks like. This role focuses on data and evaluation science for Glean's AI products, building evalsets, agentic LLM-judges, and benchmarks that capture quality. You will develop the platform and infrastructure to run these evaluations reliably at scale, and create enterprise simulation environments to test assistant and agent performance. Starting from real production usage, you will translate learnings into evaluations that guide improvements across the entire stack, from agent harnesses to tool use, skill iteration, model routing, and post-training of task-specific models. You will also bring new research into production and collaborate with R&D, product, and GTM teams to translate evaluation findings into better products and customer outcomes.

$200k - $280k

OpenAI

OpenAI's Safety Research organization is seeking a senior researcher to lead technical work on misalignment monitoring for frontier AI systems. This role involves developing methods to evaluate AI monitors, understanding their limitations, and improving our ability to reliably detect and stop concerning model behavior. You will set research priorities, design rigorous evaluations, investigate monitoring failures, and develop approaches for stress-testing and improving monitoring systems, with a key focus on understanding monitor limitations as models evolve. The position combines research leadership with hands-on technical execution, translating research findings into practical improvements for OpenAI's safety systems.

$380k - $500k

AiPrise is seeking an Engineering Manager to lead and grow the team responsible for building the company's AI agents. This is a player-coach role where you will manage, hire, and develop engineers, while also staying hands-on with agent architecture design, prompt reviews, tool definitions, and debugging evaluations. You will be responsible for the end-to-end process of building, measuring, and shipping AI agents, including the skills and tools they utilize, their memory capabilities, and the evaluation metrics that ensure quality and performance in a regulated domain like KYC and KYB. The role emphasizes the importance of quality and observability alongside speed, as inaccurate AI decisions can have significant financial and audit implications for customers.

$185k - $230k

Supabase is seeking a Software Engineer to join their Turso core database team. This role focuses on advancing the future of agentic databases, specifically by contributing to the Turso Open Source database and its Cloud offering. You will work on enhancing Postgres compatibility, ensuring system reliability, maintaining cloud operations, and improving scalability to support a massive increase in database usage. The ideal candidate thrives in a fast-paced, asynchronous environment and is passionate about building scalable database technologies for a world with millions of daily agent-created databases.

OpenAI

We are seeking a Researcher to lead our safety and alignment research, focusing on building systems that can distinguish valuable web content from spam, manipulation, and other adversarial or low-quality material. This role involves tackling the challenge of detecting coordinated manipulation that may not be apparent when evaluating individual pages in isolation. As AI advances the ease of producing convincing content at scale, you will be responsible for adapting detection systems to counter increasingly sophisticated adversaries. You will define the technical strategy, develop classifiers and evaluations, and influence how integrity signals shape Search's indexing and retrieval processes. Collaborating closely with Search and broader Safety and Integrity teams, you will leverage frontier models to enhance detection methods and implement them in production.

$380k - $850k

Cloudflare's Engineering Team builds and runs the software that handles large amounts of requests on the Internet today, as well as the internal tools and platforms that run that software. The Engineering Platform and Productivity team is chartered to build a self-service, resilient, and scalable platform using a combination of Open Source projects, intellectual property, and internal infrastructure. This role includes both software engineering and DevOps operational responsibilities, with a focus on Agentic Engineering. You will be building and managing tools to help engineers deploy and operate the services that make Cloudflare work, providing a reliable, yet flexible, platform to help product teams release new software efficiently and safely. The ideal candidate will care deeply about providing other engineers with an excellent development experience.

The Developer Productivity team at Cloudflare builds internal tools and platforms to enhance the velocity and developer experience for Cloudflare's engineering teams. This role is responsible for AI-assisted development across all of Cloudflare engineering, with significant adoption growth in the past year. As a Software Engineer on this small, high-impact team, you will have substantial ownership from day one. You will help build and operate internal platforms that enable Cloudflare engineers to develop, deploy, and run software safely and efficiently, working across developer tooling, CI/CD, GitOps, and AI-assisted development, including MCP servers, agents, evals, and context engineering. Additionally, you will contribute to governing and enforcing Cloudflare’s Engineering Codex by translating engineering standards into automated guardrails, paved paths, and actionable feedback.

At Cloudflare, we are building industrial-scale AI agents to directly support customers, moving beyond research to deliver real-world impact from day one. This role involves assembling existing Cloudflare technologies like Workers, Durable Objects, KV, R2, D1, Vectorize, Workers AI, AI Gateway, and the Agent SDK into functional agents that customers will use daily. The primary goal is to ship production agents on the Cloudflare stack, iterating rapidly through building, deploying, and learning. Your code will serve as the primary interface for Cloudflare customers interacting with these AI capabilities.

At Cloudflare, we are building industrial-scale AI agents to directly support customers, moving beyond research to deliver real-world impact from day one. This role involves assembling existing Cloudflare technologies like Workers, Durable Objects, KV, R2, D1, Vectorize, Workers AI, AI Gateway, and the Agent SDK into functional agents that customers will use daily. The primary goal is to ship production agents on the Cloudflare stack, iterating rapidly through building, deploying, and learning. Your code will serve as the primary interface for Cloudflare customers interacting with these AI capabilities.

Harvey is transforming legal and professional services by combining frontier agentic AI with an enterprise-grade platform. As we scale rapidly and take on increasingly complex use cases, we are expanding our engineering team to accelerate our ability to ship fast, delight users, and build infrastructure that scales with us. As an Engineering Manager for AI Platform, you will lead and scale a team of engineers building the foundational systems that power AI across Harvey. This includes model access and routing, agent and workflow orchestration, evaluation frameworks, tool and context infrastructure, and the observability needed to run LLM-powered products reliably at scale. You will partner with Product, Research, and product engineering teams to turn fast-moving advances in applied AI into durable, reusable platform capabilities and set the technical direction for how teams across Harvey build, test, and ship AI features. This role requires both technical depth and product intuition, with a focus on making fast, high-quality decisions, working at the cutting edge of applied AI, and growing a team that embodies engineering excellence.

$272k - $355k

Glean is building a world-class Data Organization composed of product data science, applied science, data engineering, and business intelligence groups. This is an applied science role based in our San Francisco office. You will collaborate with product data science and engineering teams to identify techniques, tooling, and process improvements in online A/B experimentation to assist rigorous decision-making across all relevant product domains. You will develop and maintain our A/B experimentation platform based on stakeholder feedback, and write code or identify vendors to deploy these techniques to production in a scalable manner that’s easy to use by engineering, product data science, product management, and design teams. You will also conduct end-to-end evaluation of various hero use cases like document/URL uploads, including evaluation set generation, coming up with evaluation criteria and methods to interpret the results. You will break down end-to-end evaluations into more granular evaluation of various tasks & skills including but not limited to content summarization/analysis/generation, multi-step reasoning & strategizing, tool selection & use, coding & system design. You will design, develop, and own best practices, tools, and processes across various evaluation problems, e.g., query intent classification, standardizing the use of best statistical principles to handle LLM stochasticity, and industry benchmarking.

$180k - $330k