Staff Research Engineer, Model Efficiency
Remote • New York • FullTime
Posted 8mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Research Engineer
About the job
Cohere is seeking a Staff Research Engineer focused on Model Efficiency to join their cutting-edge enterprise AI company. This role is crucial for pushing the boundaries of Large Language Model (LLM) inference efficiency, addressing the current bottleneck in AI system capabilities. You will be responsible for developing, prototyping, and deploying techniques that significantly improve the speed and efficiency of our foundation models in production. This is an opportunity to contribute to the widespread adoption of AI by optimizing the model execution stack, including architecture, decoding, software/hardware co-design, and performance without compromising quality.
Responsibilities
- Develop, prototype, and deploy techniques to improve LLM inference speed and efficiency.
- Optimize model architecture and MoE routing.
- Improve decoding and inference-time algorithms.
- Contribute to software/hardware co-design for GPU acceleration.
- Optimize performance without compromising model quality.
Requirements
- PhD in Machine Learning or a related field.
- Understanding of LLM architecture and inference optimization under resource constraints.
- Significant experience with techniques enhancing model efficiency.
- Strong software engineering skills.
- Experience in a fast-paced, high-ambiguity startup environment.
- Publications at top-tier conferences (ICLR, ACL, NeurIPS).
- Passion for mentoring others.
Benefits
- Weekly lunch stipend ($75/£75 or equivalent).
- Full health and dental benefits with a mental health budget.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months.
- Annual enrichment benefits (arts & culture, fitness/wellness, quality time, workspace improvement).
- Education & learning stipend for conferences, courses, and coaching.
- 6 weeks (30 working days) of paid vacation.
- Budget for traveling to other offices (for remote employees).
- Annual company offsite.
- $500 home office stipend.