Machine Learning Researcher, Foundation Models
Cupertino, California, United States
Posted 1mo ago
Job Location
Cupertino, California, United States
Tech Stack
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
We believe that the most interesting problems in deep learning research arise when we try to apply learning to real-world use cases, and this is also where the most important breakthroughs come from. You will work with a close-knit and fast growing team of world-class engineers and scientists to tackle some of the most challenging problems in foundation models and deep learning.
Further, you will have opportunities to identify and develop novel applications of deep learning in Apple products. You will see your ideas improve the experience of billions of users.
Responsibilities
In this role, you will focus on pretraining, large language model (LLM) architecture, and scientific scaling of LLM. Experiences on full-stack LLM optimization such as mid-training, reinforcement learning, data research and kernel optimization (e.g. pallas and triton) will be a plus.
Minimum qualifications
Demonstrated expertise in deep learning with publication record in relevant conferences (e.g., NeurIPS, ICML, ICLR, COLM, ACL, NAACL, EMNLP, ACL) or a track record in applying deep learning techniques to products
Proficient programming skills in Python and one of the deep learning toolkits such as JAX, PyTorch, or Tensorflow
Ability to work in a collaborative environment.
Code large language models.
PhD, or equivalent practical experience, in Computer Science, or related technical field.
Preferred qualifications
Reinforcement learning, on-policy distillation.
Post-training, mid-training large language models.
LLM context lengthening.
