AI Data Scientist
$180k - $310k • San Francisco • FullTime
Posted 10mo ago
Job Location
San Francisco
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Gamma is seeking its first Data Scientist to transform vast amounts of user data and AI outputs into actionable insights that will influence how millions of users create content. With a daily output of over 1 million AI-generated presentations and 5 million AI images, the potential for discovery is immense. Your role will involve identifying patterns, measuring key performance indicators, and contributing to faster feature development. You will design A/B tests to assess product impact, build frameworks to evaluate AI model performance across different user segments, and tackle complex questions regarding the quality of AI-generated content and user experience variations between enterprise and consumer users. Collaboration with product, engineering, and design teams will be crucial for defining quality metrics, identifying edge cases, and driving data-informed decisions. This is an individual contributor role with the potential to evolve into a leadership position, establishing the Data function at Gamma.
Responsibilities
- Build frameworks to understand AI model performance, user behavior, and product health.
- Analyze AI model outputs across user cohorts to identify quality gaps and establish metrics for improvement.
- Partner with engineering and product teams to define quality metrics for AI-generated content and user satisfaction.
- Develop statistical models and frameworks to enable product teams to make independent, data-informed decisions.
- Design and analyze large-scale A/B tests and experiments with statistical rigor to measure product impact and guide prioritization.
Requirements
- 8+ years of experience as a Data Scientist in product-focused tech companies, with experience managing or mentoring other data scientists.
- Strong statistical foundations with hands-on experience designing and analyzing A/B tests and experiments at scale.
- Experience working with large-scale data and building metrics frameworks from scratch, including modern data stack tools like dbt and Snowflake.
- Comfort analyzing unstructured or text data.
- Experience working with AI/ML products, especially LLMs or generative AI, and evaluating model performance in production.
- Ability to communicate complex technical concepts to non-technical stakeholders and influence product decisions.
- Understanding of how agentic coding is transforming the data science role and excitement about applying AI to your own work (Nice to have).
Benefits
- Benefits & equity