Senior Software Engineer - Research Platform, Consumer Devices
Remote • San Francisco • FullTime
Posted 2mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
We are seeking a Software Engineer to join our Applied Research team within the Consumer Devices group. In this role, you will build tools and services that enable AI research, evaluation, and data generation workflows. Your work will involve transforming ambiguous design questions into working research systems, collaborating closely with researchers, designers, and engineers. The goal is to simplify the creation, execution, and trustworthiness of these workflows, ensuring research artifacts have a clear lifecycle, runs are reproducible and observable, and results provide valuable evidence for product and model-training decisions. You will help maintain reliable and reusable underlying systems.
Responsibilities
- Build web applications, APIs, data models, and backend services for AI research workflows.
- Develop tools for authoring and managing evaluation tasks, rubrics, graders, suites, and rollout configurations, including workflows for publishing, versioning, auditing, and sharing research artifacts.
- Automate evaluation runs and generate reports for design, research, and engineering teams.
- Support synthetic data generation workflows for multimodal and conversational research.
- Translate product and research questions into measurable scenarios, automated graders, and human-evaluation campaigns.
- Develop measures of task quality, coverage, diversity, and semantic spread.
- Diagnose and improve reliability of application code, workers, model endpoints, deployments, and compute infrastructure.
- Lead migrations and dependent changes across research tools, evaluation systems, and supporting services.
- Partner with designers, model researchers, research engineers, and infrastructure teams to create high-quality evaluation and synthetic-data workflows.
Requirements
- 7+ years of professional software engineering experience.
- Strong full-stack experience across web applications, backend services, APIs, and data models.
- Experience owning complex systems spanning multiple services or repositories.
- Expertise in generative AI, multimodal models, or model-evaluation systems.
- Experience building effective internal tools for technical and non-technical users.
- Comfort debugging distributed workflows and production infrastructure.
- Strong product judgment and ability to translate ambiguous requirements into concrete plans.
- Ability to work effectively in a multidisciplinary team, connecting qualitative judgment to rigorous evidence.
- Clear communication skills and ability to work effectively across engineering, design, and research.
Benefits
- Relocation assistance to new employees.