Human Data - Engineer
$144k - $270k • Palo Alto, CA
Posted 5d ago
About the job
SpaceXAI is seeking a Human Data Engineer to ensure engineering teams receive high-quality data for tasks and evaluations. This role sits at the intersection of engineering and data operations, requiring partnership with model teams, designing projects to capture meaningful signals, and driving data yield and evaluation improvements. It's a hands-on technical position for engineers who understand training and evaluation deeply and wish to influence data strategy.
Responsibilities
- Partner with model and engineering teams to translate needs into data projects and evaluation strategies.
- Own end-to-end delivery of critical data and evaluation projects for model development.
- Build tools to measure data effectiveness and run evaluations to improve quality.
- Maintain data integrity and truthfulness, including validation for factual accuracy, prioritizing quality.
- Research, implement, and evaluate techniques for data collection, annotation, generation, and multimodal integration.
- Shape model behavior and domain performance through targeted data work.
- Design and improve annotation workflows, labeling interfaces, and tools for data quality.
- Act as a liaison between engineering, technical staff, and Human Data teams for alignment and knowledge sharing.
- Collaborate with Human Data Ops and stakeholders to scale projects, share learnings, and contribute to demand forecasting.
- Report status, insights, and blockers for rapid decision-making.
Requirements
- Bachelor's degree in engineering, computer science, or a related STEM discipline, or 4+ years of experience.
- Experience collaborating with cross-functional teams.
- Demonstrated experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems.
- Master's degree or higher in a relevant technical field (preferred).
- Direct experience curating, evaluating, or improving training or evaluation datasets for AI/ML systems (preferred).
- Experience designing, supporting, or optimizing annotation tools, labeling interfaces, or data workflows (preferred).
- Familiarity with multimodal data or domain-specific data (preferred).
- Experience conducting model or dataset evaluations focused on quality, truthfulness, or alignment (preferred).
- Experience in a scripting language like Python (preferred).
- Experience in SQL or other data analysis tools (preferred).
Benefits
- Equity
- Comprehensive medical, vision, and dental coverage
- Access to a 401(k) retirement plan
- Short & long-term disability insurance
- Life insurance
- Various other discounts and perks