Jailbreaking Jobs

Moveworks is seeking a Senior Staff ML Engineer to join our AI Safeguards team. In this role, you will be instrumental in designing, building, and shipping critical safeguards within our agent harness. Your work will focus on protecting against prompt injection, single and multi-turn jailbreaks, toxicity, sensitive topics, and sensitive data exposure. You will develop robust evaluation frameworks to measure the efficacy of these safeguards, addressing both false positives and false negatives using diverse datasets. Collaboration with our Security team will be key, translating their findings into actionable eval cases and fixes, and co-developing mitigations. You will also select, integrate, and fine-tune detection models within a shared stack serving both commercial and government environments, while carefully balancing quality, latency, and cost for controls operating in the request path. Additionally, you will build configurable safeguard policies to empower customers in managing sensitive topics and monitor safeguard behavior in production, addressing any regressions.