New: upload your resume and get matched to AI jobs. Free to start →

Software Engineer III, AI/ML, AI Data

London, UK • Full-time

Posted 8d ago

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Research Engineer

About the job

Google is seeking engineers to develop next-generation technologies that impact billions of users globally. This role focuses on inventing, prototyping, and building advanced techniques and pipelines for analyzing model behavior and evaluating complex reasoning. You will work at the intersection of applied research and software engineering, exploring new methods to assess model failure modes, prototyping novel evaluation tasks, and transforming experimental insights into robust, scalable benchmarks and data flywheels. Collaborating with researchers and engineers across Google DeepMind and AI Data, you will conduct empirical analyses, build programmatic verifiers, and enhance the measurement of frontier model capabilities in areas like code, math, and specialized domains.

Responsibilities

  • Research, experiment, and prototype novel approaches for analyzing model behavior and failure patterns.
  • Conduct empirical investigations into model outputs, agent trajectories, and error patterns to inform benchmark design and improve evaluation trustworthiness.
  • Implement, test, and refine benchmark suites evaluating complex agentic reasoning across code, math, and specialized domains.
  • Develop and maintain pipelines to transform execution logs and agent traces into high-fidelity evaluation datasets and training data.
  • Partner with research scientists and engineers to translate research insights into practical evaluation infrastructure.

Requirements

  • Bachelor's degree or equivalent practical experience.
  • 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
  • 1 year of experience with end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging).
  • Experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or related concepts (e.g., language modeling, computer vision).
  • Experience in Generative AI.
  • Experience in Python.
  • Master's degree or PhD in Computer Science or related technical fields (preferred).
  • 2 years of experience with data structures and algorithms (preferred).
  • Experience developing accessible technologies (preferred).
  • Skills and experience in data analysis (preferred).

About Google