Software Engineer, Model Lifecycle and Signals
New York • FullTime
Posted 5h ago
Remote Work Policy
On-site
Employment Type
FullTime
Categories
LLM Engineer
About the job
SpaceXAI is building Super Intelligence to help humanity understand the universe, developing the full stack from supercomputers to Grok models and a suite of applications. As a Software Engineer on the Model Lifecycle and Signals team, you will be responsible for bridging frontier models with user-facing products at an immense scale. You will determine model selection, identify and rectify model deviations, and influence the development of future models. This role integrates infrastructure, data, and product responsibilities, involving the deployment of models from preview to production, analyzing real-world data to assess performance, and collaborating with research, inference, product, and data science teams to enhance both products and models. Your contributions will have a compounding effect across all products and shipped models.
Responsibilities
- Deploy new frontier models to users and retire outdated ones seamlessly.
- Evaluate internal and external preview models prior to launch and provide constructive feedback.
- Develop the Cursor Router to intelligently select models for each request, optimizing for quality, speed, and cost at scale.
- Create systems to monitor model performance, identify areas of failure, and establish metrics for improvement.
Requirements
- Exceptional engineering skills with a proven history of delivering reliable production systems.
- Experience building and operating evaluation, measurement, or model serving systems (e.g., AI evals, experimentation, routers).
- Ability to translate ambiguous quality assessments into quantifiable metrics, pipelines, and decisions.
- Proficiency in data analysis and effective collaboration with data scientists and researchers.
- Strong judgment and curiosity regarding model and agent behavior, with a proactive approach to testing new models.