New: upload your resume and get matched to AI jobs. Free to start →

Principal UX Researcher, AI Experiences

$143k - $275k • United States, California, Mountain View; United States, Washington, Redmond • Full-time

Posted 16d ago

Job Location

United States, California, Mountain View; United States, Washington, Redmond

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Engineer

About the job

AI is evolving from simple question answering to performing complex tasks. This role focuses on a new kind of user experience where individuals delegate multi-step tasks and expect completed work in return. The core of this position involves understanding user behavior, identifying unmet needs and points of friction, and translating these insights into improved user experiences. Success will be measured by the ability to provide product teams with an evidence-based understanding of user behavior, prioritize friction points for improvement, establish benchmarks for user experience, and conduct regular evaluations of AI agent performance against competitors. This is a hands-on, individual contributor role with significant influence across product, design, engineering, and data science teams.

Responsibilities

  • Understand user engagement with the product by analyzing telemetry, surveys, and interviews to map user demographics, task usage, usage trends, and factors influencing user retention.
  • Lead generative research, including contextual inquiry and in-depth interviews, to uncover unmet needs and identify new product opportunities and capabilities.
  • Identify and quantify user friction points across the entire user journey, from discovery to task delegation and output review, to prioritize areas for improvement.
  • Assess how well product capabilities meet user expectations within their workflows and identify gaps that hinder trust and adoption.
  • Collaborate with design and product teams on concept development, prototyping, and usability testing, establishing and measuring experience benchmarks.
  • Contribute to the design and execution of agentic evaluations, including task set design, rubric development, and analysis, to assess competitive performance and inform the quality roadmap.
  • Apply quantitative methods to research design, including survey and experiment design, statistical modeling, and user segmentation, to connect user feedback with observed behavior.
  • Lead research initiatives, influence product and quality decisions with senior stakeholders, and mentor other researchers in mixed-methods and evaluation techniques.

Requirements

  • Doctorate in a relevant field (HCI, Behavioral Science, etc.) with 3+ years of UX research experience, OR Master's degree with 4+ years, OR Bachelor's degree with 6+ years, OR equivalent experience.
  • Strong mixed-methods research skills with a quantitative focus, including survey design, experimental design, statistical modeling, and qualitative methods like interviews and usability testing.
  • Proficiency in R or Python, and SQL or KQL for data analysis.
  • Experience researching AI-powered products, particularly those that perform actions or generate work on behalf of users.
  • Proven track record of research influencing product strategy and shipping user experiences in ambiguous environments.