Member of Technical Staff - Evaluation Infrastructure
$180k - $440k • Palo Alto, CA
Posted 8h ago
Job Location
Palo Alto, CA
Tech Stack
Remote Work Policy
On-site
Categories
LLM Engineer
About the job
SpaceXAI is seeking an engineer to join our RL infrastructure team and help develop our evaluation infrastructure. This role involves building highly reliable, efficient, and user-friendly systems to run evaluations at scale. You will collaborate with modeling and evaluation teams to develop new evaluations, maintain signal quality, and create internal tooling for training next-generation models. A key part of this role is identifying and resolving performance bottlenecks across the entire evaluation infrastructure stack, including inference, capacity fleet management, and asynchronous evaluation orchestration.
Responsibilities
- Build highly reliable, efficient, and easy-to-use infrastructure for running evaluations at scale.
- Collaborate with modeling and evaluation teams on developing new evaluations and maintaining signal quality.
- Build internal tooling to support training next-generation models.
- Identify and resolve performance bottlenecks in inference, capacity fleet management, and asynchronous eval orchestration.
Requirements
- Experience building, debugging, and optimizing large-scale distributed systems.
- Willingness to solve complex problems at all levels of the stack.
Benefits
- Equity
- Comprehensive medical, vision, and dental coverage
- Access to a 401(k) retirement plan
- Short & long-term disability insurance
- Life insurance
- Various other discounts and perks