Senior Applied AI Engineer 2

About the job

Responsibilities

• Design and evaluate information access and reasoning strategies across RAG, agents, and classic ML, including chunking, embedding models, hybrid search, metadata filtering, and semantic routing.
• Prototype GenAI workflows, including agentic systems, that map and reason over compliance objects.
• Explore ML and probabilistic approaches where GenAI is not the best fit, such as classifiers, ranking models, graph/link prediction, calibration, and structured prediction.
• Build and maintain evaluation frameworks, including golden datasets, automated quality metrics, and regression detection.
• Implement and tune ranking/reranking systems, including cross-encoders, LLM-based rerankers, learning-to-rank, and custom scoring functions.
• Run experiments to validate hypotheses and quantify improvements before production rollout.
• Debug failure modes and build error taxonomies across retrieval, reasoning, and generation.
• Collaborate with AI and Software Engineers to hand off validated approaches for productionization.
• Stay current on applied research in RAG, agents, LLM evaluation, and relevance modeling, and bring innovations into the product.

Requirements

• 6+ years of experience in applied research, data science, or ML with a focus on NLP, information retrieval, or knowledge systems.
• 2+ years of hands-on experience building or contributing to production AI/ML systems.
• Strong foundation in information retrieval, including dense and sparse retrieval, embedding models, and search relevance.
• Experience with RAG systems, including chunking strategies, vector databases, and retrieval optimization.
• Proficiency in evaluation methodology, including metrics design, golden dataset creation, A/B testing, and statistical significance.
• Strong Python skills and comfort with notebook-driven research workflows.
• Experience communicating research findings to engineering teams and translating insights into actionable improvements.
• Bonus: Experience with compliance, legal, or document-heavy domains.
• Bonus: Publications or contributions in IR, NLP, or RAG evaluation.

Benefits

• Stock equity
• Up to 100% employer-paid premiums for medical, dental, and vision coverage for employees and their dependents
• Comprehensive wellness benefits and healthcare concierge services
• 401(k) plan
• Company-paid life and disability insurance
• Tax-advantaged spending accounts
• Discounted voluntary offerings
• Paid Parental Leave policy
• Kindbody fertility and family-building benefits
• Dedicated leave specialists
• Generous annual stipends for professional and personal development