Evaluation design Jobs
4 open roles mentioning Evaluation design
Software Engineer, Full-Stack
Ema
Ema builds AI Employees for HR, IT, and Finance, automating busy work across the employee experience. Our AI Employees handle tasks from recruiting and onboarding to IT support and payroll, allowing people to focus on more critical work. Founded by former executives from Google, Coinbase, Flipkart, and Okta, our team comprises engineers from top tech companies and graduates from prestigious universities. We are backed by leading investors and operate at the forefront of Agentic AI, shipping real systems that manage business processes at scale.
Research Scientist
Roboflow
Roboflow Labs is seeking a Research Scientist to join their applied research unit. This role sits at the intersection of benchmarks, models, and frontier labs, focusing on failure analysis, dataset specification, and validation of data quality. The scientist will contribute to publishing new benchmarks, extending existing ones like RF100-VL, and shaping the research agenda with work grounded in real-world deployments. This position offers the opportunity to see research directly translate into shipped data products and influence the direction of AI development.
$250k - $450k
Member of Technical Staff - Post Training, Applied
Liquid AI
Liquid AI, spun out of MIT CSAIL, builds general-purpose AI systems that run efficiently across various deployment targets. We partner with enterprises in consumer electronics, automotive, life sciences, and financial services. This role offers a unique opportunity to lead applied post-training work end-to-end for text workloads, adapting Liquid Foundation Models for major enterprise clients. You will serve as the technical liaison between customer needs and model delivery, owning engagements from scoping to evaluation. Between projects, you will develop reusable applied workflows and tooling to enhance future delivery. This position is ideal for someone passionate about data quality, evaluation design, and making language models effective in production environments.
Applied AI Engineer - Agent
The General Intelligence Company of New York
We are seeking an Applied AI Engineer to advance the capabilities of our Cofounder agent. This role involves owning core backend systems and applied LLM work, focusing on enhancing agent reliability and autonomy. You will be responsible for building evaluation pipelines and implementing techniques that demonstrably improve agent performance. This is a hands-on position with significant ownership, covering the entire research-to-production lifecycle, including prototyping, instrumentation, evaluation, and deployment of user-facing improvements.
$250k - $300k