Human Data Manager
$100k - $186k • Palo Alto, CA
Posted 5d ago
About the job
SpaceXAI is seeking a Human Data Manager to ensure engineering teams receive high-quality tasks and evaluations by crafting and executing high-value Human Data projects. This role sits at the intersection of model teams and data operations, partnering with engineering to design projects that capture meaningful signals and drive the measurement of data impact. It's a hands-on position for individuals with a deep understanding of training and evaluation who want to influence data strategy.
Responsibilities
- Partner with model and engineering teams to understand needs and translate them into high-value data projects and evaluation strategies.
- Own end-to-end delivery of critical data and evaluation projects that capture meaningful training signals and support rapid model development.
- Leverage AI agents and existing platforms to measure data effectiveness and quantify impact.
- Maintain rigorous data integrity and truthfulness, including validation processes for factual accuracy.
- Research and apply techniques for data collection, annotation, generation, and multi-modal integration.
- Shape model behavior and domain performance through targeted data work.
- Improve annotation workflows using agents and no/low-code approaches.
- Manage plans that shape model behavior via data management, optimization, and analysis.
- Act as a liaison between engineering, technical staff, and Human Data teams to drive alignment and knowledge sharing.
- Collaborate with Human Data Ops and stakeholders to scale projects, share learnings, and contribute to demand forecasting.
Requirements
- Bachelor's degree or 4+ years of relevant experience.
- Experience collaborating with cross-functional teams.
- Demonstrated experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems.
- Degree in engineering, computer science, data analysis, or a related STEM discipline (preferred).
- Direct experience curating, evaluating, or improving training or evaluation datasets for large language models or other AI/ML systems (preferred).
- Experience designing, supporting, or optimizing annotation workflows or data processes (preferred).
- Familiarity with multimodal data or domain-specific data (preferred).
- Experience with model or dataset evaluations focused on quality, truthfulness, or alignment with product goals (preferred).
- Comfort using AI agents, no/low-code tools, or light scripting (e.g., Python) to prototype workflows and measurement (preferred).
- Experience with SQL or other data analysis tools (preferred).
Benefits
- Equity
- Comprehensive medical, vision, and dental coverage
- Access to a 401(k) retirement plan
- Short & long-term disability insurance
- Life insurance
- Various other discounts and perks