New: upload your resume and get matched to AI jobs. Free to start →

On-Device ML Infrastructure Engineer (Core AI Runtime), Graphics, Games and Machine Learning

Cupertino, California, United States

Posted 1mo ago

Job Location

Cupertino, California, United States

Tech Stack

Remote Work Policy

On-site

Categories

AI Infrastructure Engineer

About the job

We’re building an end-to-end developer experience for machine learning development that employs Apple’s vertical integration. This allows developers to iterate on model authoring, optimization, transformation, execution, debugging, profiling, and analysis.

This role focuses on the Core AI Runtime for execution on-device. In this role, you will build the world’s most advanced ML graph compilation and runtime system, capable of optimizing and delivering ML models efficiently on Apple products and services.

Responsibilities

Architect and maintain the on-device graph compiler, runtime, and kernels for delivering ML operators.

Develop production-critical system software for implementing ML models on Apple Silicon

Proactively identify and resolve functionality gaps.

Optimize model execution for various system objectives like performance, energy efficiency, and thermal management.

Minimum qualifications

Masters or equivalent experience in Computer Sciences, Engineering, or related subject area.

Highly proficient in C++ or Swift. Familiarity with Python.

Experience with any compiler stack (MLIR/LLVM/TVM/...).

Familiarity with Operating Systems, embedding programming, parallel programming.

Sound understanding of ML fundamentals, including common architectures such as Transformers.

Good communication skills, including ability to communicate with multi-functional audiences.

Preferred qualifications

Experience with any on-device ML stack, such as TFLite, ONNX, ExecuTorch, etc.

Experience with any ML authoring framework (PyTorch, TensorFlow, JAX, etc.) is a strong plus.

Experience with accelerators, GPU programming is a strong plus.