Software Engineer, RL Inference
$180k - $440k • Remote • Palo Alto, CA
Posted 1d ago
Job Location
Palo Alto, CA
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Research Engineer
About the job
SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack, from supercomputers to Grok models and a suite of applications. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next. The RL infrastructure team is looking for an engineer to help with low precision RL training and inference.
Responsibilities
- Design and optimize the inference stack for RL workloads, from small scale ablations to production training runs.
- Analyze, profile, and address performance bottlenecks in large-scale RL systems.
- Collaborate with the modeling team to efficiently implement novel RL techniques and algorithms.
Requirements
- Experience building, debugging, and optimizing the efficiency of large-scale distributed systems.
- Experience with LLM inference.
- Proficiency in programming languages such as Python, C++, and/or Rust.
- Familiarity with frameworks like PyTorch, Jax, and CUDA.
- Willingness to solve complex problems at all levels of the stack.
Benefits
- Equity
- Comprehensive medical, vision, and dental coverage
- Access to a 401(k) retirement plan
- Short & long-term disability insurance
- Life insurance
- Various other discounts and perks