Research Engineer
New York - Hybrid; San Francisco Bay Area - Hybrid
Posted 13d ago
Job Location
New York - Hybrid; San Francisco Bay Area - Hybrid
Tech Stack
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
Invisible Technologies is seeking a Research Engineer to join its research organization, focusing on reinforcement learning, evaluation methodology, benchmarks, and RL environments for frontier labs and enterprise clients. This role involves defining how frontier models are measured, with direct influence over the methodology and its implementation. You will translate research questions into practical scoring frameworks, evaluation architectures, or environment designs, and then build the production systems to run them. This is a hands-on role for someone who wants to design the approach and write the code to prove it out, with reporting lines varying by experience level.
Responsibilities
- Design benchmarks and RL environments to measure real model capability for frontier labs and enterprise clients.
- Originate evaluation methodology and translate it into scoring frameworks, rubrics, and evaluation architectures.
- Write and ship production code that implements your designs.
- Build and maintain data pipelines for evaluation runs.
- Run analysis to establish result validity and ensure evaluation reproducibility.
- Partner with Research Scientists on methodology review, Solutions Architects on client requirements, and ML software engineers on platform maintenance.
Requirements
- Production-quality code written daily.
- Fluency in Python and comfort with the modern ML stack.
- Real experience building evaluation systems, RL environments, or training and inference infrastructure.
- Hands-on experience with modern agentic flows.
- Familiarity with reinforcement learning methods and frontier model evaluation.
- A track record of turning ambiguous research questions into working systems, and publishing or shipping the result.
Benefits
- Bonuses and equity are included in all full-time offers.
- Additional details on total compensation and benefits will be discussed during the hiring process.