New: upload your resume and get matched to AI jobs. Free to start →

Senior Machine Learning Engineer, Multimodal Intelligence for Apple Pencil

Cupertino, California, United States

Posted 2d ago

Job Location

Cupertino, California, United States

Tech Stack

Remote Work Policy

On-site

Categories

Machine Learning Engineer

About the job

In this role, you will participate in building the machine learning systems that bring intelligence to Apple Pencil. Your work will span perception and generation: understanding rich, free-form ink in its full multimodal context, and powering generative features that create and transform content from it. Expect to use both large language models and classical machine learning, applying whichever is right for each feature.

You will own problems end to end, from framing the interaction and prototyping on iPad with real Pencil input to measuring success and shipping, in close partnership with design, frameworks, and app teams across Apple. You will stay at the forefront of AI research to rapidly apply impactful developments, while pioneering new ideas designed specifically for Apple Pencil and Apple's ecosystem.

Responsibilities

Design multimodal ML systems that combine ink with context to power intelligent and generative features.

Build evaluation for open-ended multimodal tasks, from automatic metrics to model judges and human evaluation.

Adapt, fine-tune, and distill models to meet on-device latency, memory, and privacy requirements.

Collaborate across design, human interface, framework, and app teams to turn prototypes into shipping features.

Minimum qualifications

5+ years of industry experience building ML-powered product features, including hands-on work with multimodal models.

Experience taking an ML system from prototype through evaluation to deployment in production.

Strong software engineering skills in Python and at least one of Swift, C++, or Objective-C.

Experience with a modern ML framework such as PyTorch or JAX.

MS or PhD in Computer Science or a related field, or equivalent industry experience.

Experience with building agentic workflows and designing LLM-based evaluation judges

Preferred qualifications

Proficiency with agentic coding tools and workflows for prototyping, optimization and developing production code

Experience with generative models for images or other visual content

Experience with on-device machine learning, including quantization, distillation, latency and memory budgets