Evaluation design Jobs

4 open roles mentioning Evaluation design

Software Engineer, Full-Stack

16d ago
E

Ema

Ema builds AI Employees for HR, IT, and Finance, automating busy work across the employee experience. Our AI Employees handle tasks from recruiting and onboarding to IT support and payroll, allowing people to focus on more critical work. Founded by former executives from Google, Coinbase, Flipkart, and Okta, our team comprises engineers from top tech companies and graduates from prestigious universities. We are backed by leading investors and operate at the forefront of Agentic AI, shipping real systems that manage business processes at scale.

San Francisco Bay Area remote FullTime
GovLLMRL environments +8 more

Research Scientist

26d ago
R

Roboflow

Roboflow Labs is seeking a Research Scientist to join their applied research unit. This role sits at the intersection of benchmarks, models, and frontier labs, focusing on failure analysis, dataset specification, and validation of data quality. The scientist will contribute to publishing new benchmarks, extending existing ones like RF100-VL, and shaping the research agenda with work grounded in real-world deployments. This position offers the opportunity to see research directly translate into shipped data products and influence the direction of AI development.

$250k - $450k

San Francisco onsite FullTime
Fine-TuningComputer VisionMachine Learning +7 more

Member of Technical Staff - Post Training, Applied

8mo ago
L

Liquid AI

Liquid AI, spun out of MIT CSAIL, builds general-purpose AI systems that run efficiently across various deployment targets. We partner with enterprises in consumer electronics, automotive, life sciences, and financial services. This role offers a unique opportunity to lead applied post-training work end-to-end for text workloads, adapting Liquid Foundation Models for major enterprise clients. You will serve as the technical liaison between customer needs and model delivery, owning engagements from scoping to evaluation. Between projects, you will develop reusable applied workflows and tooling to enhance future delivery. This position is ideal for someone passionate about data quality, evaluation design, and making language models effective in production environments.

San Francisco remote FullTime
LLMFine-TuningPyTorch +8 more

Applied AI Engineer - Agent

1y ago
T

The General Intelligence Company of New York

We are seeking an Applied AI Engineer to advance the capabilities of our Cofounder agent. This role involves owning core backend systems and applied LLM work, focusing on enhancing agent reliability and autonomy. You will be responsible for building evaluation pipelines and implementing techniques that demonstrably improve agent performance. This is a hands-on position with significant ownership, covering the entire research-to-production lifecycle, including prototyping, instrumentation, evaluation, and deployment of user-facing improvements.

$250k - $300k

New York remote FullTime
PythonRAGPrompt Engineering +9 more

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.