On-Device ML Infrastructure Engineer (Core AI Runtime), Graphics, Games and Machine Learning
Cupertino, California, United States
Posted 1mo ago
Job Location
Cupertino, California, United States
Tech Stack
Remote Work Policy
On-site
Categories
AI Infrastructure Engineer
About the job
We’re building an end-to-end developer experience for machine learning development that employs Apple’s vertical integration. This allows developers to iterate on model authoring, optimization, transformation, execution, debugging, profiling, and analysis.
This role focuses on the Core AI Runtime for execution on-device. In this role, you will build the world’s most advanced ML graph compilation and runtime system, capable of optimizing and delivering ML models efficiently on Apple products and services.
Responsibilities
Architect and maintain the on-device graph compiler, runtime, and kernels for delivering ML operators.
Develop production-critical system software for implementing ML models on Apple Silicon
Proactively identify and resolve functionality gaps.
Optimize model execution for various system objectives like performance, energy efficiency, and thermal management.
Minimum qualifications
Masters or equivalent experience in Computer Sciences, Engineering, or related subject area.
Highly proficient in C++ or Swift. Familiarity with Python.
Experience with any compiler stack (MLIR/LLVM/TVM/...).
Familiarity with Operating Systems, embedding programming, parallel programming.
Sound understanding of ML fundamentals, including common architectures such as Transformers.
Good communication skills, including ability to communicate with multi-functional audiences.
Preferred qualifications
Experience with any on-device ML stack, such as TFLite, ONNX, ExecuTorch, etc.
Experience with any ML authoring framework (PyTorch, TensorFlow, JAX, etc.) is a strong plus.
Experience with accelerators, GPU programming is a strong plus.
