Senior Machine Learning Engineer, Multimodal Intelligence for Apple Pencil

AppleCupertino, CaliforniaOn-siteFull-timeSenior, 5–8 yearsListed 22 minutes ago

Apply now

About this role

Do you believe intelligence can transform how people write, draw, and create? Are you excited by the chance to take Apple Pencil's intelligence to the next level? We are an applied machine learning team behind interactive intelligent features like Scribble, Math Notes, and Smart Script. We're looking for an engineer who can work from multimodal foundation models to on-device optimization, and who's passionate about shipping technologies that empowers the creative workflows of hundreds of millions of users.

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It's the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you'll do more than join something — you'll add something.

In this role, you will participate in building the machine learning systems that bring intelligence to Apple Pencil. Your work will span perception and generation: understanding rich, free-form ink in its full multimodal context, and powering generative features that create and transform content from it. Expect to use both large language models and classical machine learning, applying whichever is right for each feature.

You will own problems end to end, from framing the interaction and prototyping on iPad with real Pencil input to measuring success and shipping, in close partnership with design, frameworks, and app teams across Apple. You will stay at the forefront of AI research to rapidly apply impactful developments, while pioneering new ideas designed specifically for Apple Pencil and Apple's ecosystem.

Minimum Qualifications

5+ years of industry experience building ML-powered product features, including hands-on work with multimodal models.
Experience taking an ML system from prototype through evaluation to deployment in production.
Strong software engineering skills in Python and at least one of Swift, C++, or Objective-C.
Experience with a modern ML framework such as PyTorch or JAX.
MS or PhD in Computer Science or a related field, or equivalent industry experience.
Experience with building agentic workflows and designing LLM-based evaluation judges

Preferred Qualifications

Proficiency with agentic coding tools and workflows for prototyping, optimization and developing production code
Experience with generative models for images or other visual content
Experience with on-device machine learning, including quantization, distillation, latency and memory budgets