New: upload your resume and get matched to AI jobs. Free to start →

Machine Learning Researcher, Foundation Models

Cupertino, California, United States

Posted 1mo ago

Job Location

Cupertino, California, United States

Tech Stack

Remote Work Policy

On-site

Categories

AI Research Engineer

About the job

We believe that the most interesting problems in deep learning research arise when we try to apply learning to real-world use cases, and this is also where the most important breakthroughs come from. You will work with a close-knit and fast growing team of world-class engineers and scientists to tackle some of the most challenging problems in foundation models and deep learning.

Further, you will have opportunities to identify and develop novel applications of deep learning in Apple products. You will see your ideas improve the experience of billions of users.

Responsibilities

In this role, you will focus on pretraining, large language model (LLM) architecture, and scientific scaling of LLM. Experiences on full-stack LLM optimization such as mid-training, reinforcement learning, data research and kernel optimization (e.g. pallas and triton) will be a plus.

Minimum qualifications

Demonstrated expertise in deep learning with publication record in relevant conferences (e.g., NeurIPS, ICML, ICLR, COLM, ACL, NAACL, EMNLP, ACL) or a track record in applying deep learning techniques to products

Proficient programming skills in Python and one of the deep learning toolkits such as JAX, PyTorch, or Tensorflow

Ability to work in a collaborative environment.

Code large language models.

PhD, or equivalent practical experience, in Computer Science, or related technical field.

Preferred qualifications

Reinforcement learning, on-policy distillation.

Post-training, mid-training large language models.

LLM context lengthening.