Research Intern, Inference (Summer 2027)
Remote • San Francisco
Posted 24d ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Research Engineer
About the job
The Inference Research team is dedicated to building the next generation of efficient, scalable, and reliable serving systems for large foundation models, advancing open and transparent AI. This role operates at the intersection of model architectures, high-performance systems engineering, and hardware optimization, focusing on co-designing software, algorithms, and models to reduce the cost and latency of AI systems. As a research intern, you will explore distributed inference, compiler-aware optimization, and novel inference-time computation strategies, co-designing and implementing cross-layer optimizations across models, systems, and hardware.
Responsibilities
- Design and conduct experiments to validate hypotheses.
- Communicate project plans, progress, and results to the team.
- Document findings in scientific publications and blog posts.
Requirements
- Currently pursuing a final year of Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or a related field.
- Strong knowledge of Machine Learning and Deep Learning fundamentals.
- Experience with deep learning frameworks like PyTorch or JAX.
- Strong programming skills in Python.
- Familiarity with Transformer architectures and foundation models.
Benefits
- Competitive compensation
- Housing stipends
- Other competitive benefits