Member of Technical Staff (Product Data Scientist, Search Quality)
Belgrade • FullTime
Posted 1mo ago
About the job
Perplexity is seeking an experienced Product Data Scientist to drive the advancement of search technologies. This role involves identifying strong and sensitive signals from user behavior to enhance the efficiency of A/B experiment data analysis. You will contribute to shaping the product roadmap and accelerating user adoption through data-driven insights, hypothesis validation via A/B testing, and the design of new pipelines for improved ranking quality. This includes discovering new signals, producing metrics, and constructing data labeling pipelines utilizing both human and LLM feedback.
Responsibilities
- Develop data-driven insights from user behavior to inform product roadmap and accelerate adoption.
- Formulate and validate hypotheses by designing, running, and analyzing A/B tests.
- Determine and implement appropriate metrics and visualizations for tracking in dashboards.
- Design new pipelines to improve ranking quality, including signal discovery, metric production, and data labeling with human and LLM feedback.
Requirements
- 4+ years of experience as a data analyst or in a related role.
- Experience with search-related products, focusing on online metrics and A/B experiment analysis.
- Strong Python skills for writing production-grade code.
- Proficiency with SQL.
- Experience with Business Intelligence (BI) tools.
- Deep knowledge of statistics.