Evaluation pipelines Jobs

CHAOS Industries is seeking a highly motivated, mission-oriented Applied AI Engineer to help develop, integrate, and deploy AI/ML-powered capabilities across its product lines. This role involves working closely with data scientists, software engineers, product teams, and mission stakeholders to conduct advanced AI research and translate it into reliable, real-world software, with a particular focus on defense applications requiring extreme accuracy under constrained, adversarial, and complex operational conditions. The ideal candidate possesses strong data science and software engineering fundamentals, a track record of technical excellence, and demonstrated experience applying AI/ML techniques to real products, with a strong plus for experience in aerospace, defense, critical infrastructure, robotics, RF systems, or other highly regulated or mission-driven environments. Comfort with operating independently, quickly learning new technical domains, collaborating across teams, and moving prototypes toward production with limited oversight is essential.

$140k - $193k

Figma is seeking a Director, Research - AI Evals to lead the measurement of quality for Figma's AI-powered experiences. This role is crucial as Figma integrates more AI capabilities, requiring a rigorous approach to defining and assessing "good" AI features. You will establish frameworks, quality standards, and trusted signals that guide product teams in their AI feature development and release decisions. The ideal candidate possesses deep, hands-on experience in evaluating AI/LLM products, combining human and automated methods, with strong product intuition and communication skills to ensure evaluation is impactful. You will collaborate with Product, Design, Engineering, and Data Science teams, influencing AI shipping decisions that affect millions of users.

$258k - $348k