Member of Engineering (Evaluations)
Remote • Remote (EMEA/East Coast) • FullTime
Posted 5mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Poolside is building a company to create Artificial General Intelligence, aiming to be a leader in applied research, engineering, infrastructure, and large-scale deployment. We are a remote-first team spread across Europe and North America, with monthly in-person meetups and biannual offsites. Our teams blend research and engineering expertise, emphasizing strong software development knowledge and a commitment to system quality for faster iteration and compounded efforts. This role is crucial in ensuring our progress translates into meaningful improvements for our users.
Responsibilities
- Research and implement evaluations and benchmarks for base and instruction-following models.
- Collaborate with applied research and product teams to define metrics and evaluations for real-world software development skills.
- Participate in team planning, discussions, and clear communication with peers.
Requirements
- Experience with Large Language Models (LLMs).
- Strong understanding and intuition of LLMs and their limitations.
- Good taste and a curious mindset.
- Strong engineering background.
- Strong programming skills, ideally across multiple languages.
- Familiarity with the full software development lifecycle.
- Programming experience.
- Linux proficiency.
- Strong algorithmic skills.
- Proficiency in multiple languages, including Python.
- Experience with modern development tools and a drive for continuous improvement.
- Strong critical thinking skills and the ability to question code quality policies.
Benefits
- Fully remote work and flexible hours.
- 37 days/year of vacation and holidays.
- Health insurance allowance for you and dependents.
- Company-provided equipment.
- Wellbeing, always-be-learning, and home office allowances.
- Frequent team get-togethers.
- Great diverse & inclusive people-first culture.