Research Scientist / Engineer — Foundation Model (Agent)
$30k - $60k • Remote • Redwood City, CA • FullTime
Posted 1mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Luma is seeking a Research Scientist/Engineer to build and train large-scale multimodal agentic models capable of reasoning, planning, coding, and tool utilization for complex, multi-step tasks involving pixels. This core research role spans modeling, data, systems, and evaluation, tackling novel problems where both scientific and engineering expertise are equally crucial. The ideal candidate will have a strong foundation in large-scale model training and agentic systems, and is comfortable working across multiple layers of the technology stack.
Responsibilities
- Architect large-scale multimodal agentic models that use reasoning, planning, coding, and tool calling for complex, multi-step work.
- Design, build, and run robust data pipelines to construct, enrich, and filter massive pixel datasets, and formulate new tasks.
- Train large-scale multimodal models on massive datasets and GPU clusters.
- Define and build novel evaluation frameworks to measure multimodal agents.
Requirements
- Strong foundation in machine learning, foundation models, and agentic systems.
- Deep understanding of agentic systems and LLM/VLM reasoning, coding models, and tool calling.
- Hands-on PyTorch and large-scale training (distributed, mixed precision, large datasets).
- Experience with state-of-the-art foundation models in reasoning, coding, or tool calling, or state-of-the-art multimodal agents.