Model Engineer, Mid-training
$180k - $440k • Palo Alto, CA
Posted 11h ago
Job Location
Palo Alto, CA
Tech Stack
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.
Responsibilities
- Scale synthetic coding data to trillions of tokens with large-scale docker verification
- Distill the intelligence of flagship models into flash models through synthetic data generation
- Optimize mid-training data mixtures to boost the ceiling for RL
- Engineer long-context data recipes
- Develop robust and diverse evaluation for mid-training checkpoints
Requirements
- Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
Benefits
- Equity
- Comprehensive medical, vision, and dental coverage
- Access to a 401(k) retirement plan
- Short & long-term disability insurance
- Life insurance
- Various other discounts and perks