Senior Machine Learning Engineer, Multimodal Intelligence for Apple Pencil
Job Description
Senior Machine Learning Engineer role in Cupertino, building intelligence for Apple Pencil through multimodal machine learning and generative features.
Responsibilities
- Build machine learning systems that power Apple Pencil intelligence.
- Develop both perception and generation capabilities, including understanding rich, free-form ink across its multimodal context.
- Enable generative features that create and transform content from ink.
- Apply large language models and classical machine learning, selecting approaches appropriate for each feature.
- Own end-to-end problem solving, from interaction framing and iPad prototyping with real Pencil input, to evaluation, success measurement, and shipping.
- Collaborate closely with design, frameworks, and app teams across Apple.
- Continuously apply impactful advances from AI research, while pioneering new ideas tailored to Apple Pencil and Apple’s ecosystem.
Requirements
- 5+ years of industry experience building ML-powered product features, including hands-on work with multimodal models.
- Experience moving an ML system from prototype through evaluation to production deployment.
- Strong software engineering skills in Python and at least one of Swift, C++, or Objective-C.
- Experience with a modern ML framework such as PyTorch or JAX.
- MS or PhD in Computer Science or a related field (or equivalent industry experience).
- Experience building agentic workflows and designing LLM-based evaluation judges.
Technology Stack
- Python
- Swift, C++, Objective-C
- PyTorch, JAX
- Large language models
- Multimodal models
- LLM-based evaluation judges
- iPad, Apple Pencil
Preferred Qualifications
- Proficiency with agentic coding tools and workflows for prototyping, optimization, and developing production code.
- Experience with generative models for images or other visual content.
- Experience with on-device machine learning, including quantization, distillation, and managing latency and memory budgets.
Benefits
- Comprehensive medical and dental coverage
- Retirement benefits
- Discounted products and free services
- Reimbursement for certain educational expenses (including tuition)
Location: Cupertino, CA (onsite)
Compensation: USD 184,700 - 324,800 per year
Experience: 5+ years