Sr Data Scientist, Evaluation

Apple’s Evaluation team focuses on measurable product impact, helping improve the quality of Apple user facing experiences such as Siri and Apple Intelligence. In this role, you’ll develop and apply evaluation methods that translate into everyday technology for product engineering, using advanced analytics on large datasets and LLM-based judging to support better decisions across Apple products.

Location: Cupertino, CA (onsite)

Compensation: Base pay range is USD 150,400 to 277,600 per year. Base pay is one part of Apple’s total compensation package and is determined within a range.

What you’ll do

• Research and develop evaluation methods to improve the quality of Apple user facing products, including Siri and Apple Intelligence.
• Partner with evaluation and experimentation engineering teams to productionize your methodological developments for product engineering use.
• Work with large, complex data sets to support accurate evaluation and insight generation.
• Solve difficult, non-routine analysis problems using advanced analytical methods, including prompt engineering and building LLMs as judges.
• Lead analysis that includes data collection and quality control, requirements specification, processing, and presentations.
• Build and prototype analysis pipelines iteratively to deliver insights at scale.
• Develop deep knowledge of product data structures and metrics, advocating for changes where needed for product development.
• Collaborate closely with product engineering on core machine learning algorithms and user experience evaluations.

What you bring

• An advanced degree in a quantitative field such as Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics, or a similar quantitative discipline.
• Proficiency in data science, machine learning, and analytics, including statistical data analysis.
• Experience crafting, conducting, analyzing, and interpreting experiments and investigations, particularly around data quality, evaluation, and risk assessment.
• Strong programming skills, including data querying (such as SQL and/or Spark) and experience with a scripting language for data processing and development (such as Python, R, or Scala).
• Experience translating business questions into analysis using statistical techniques with available data.
• Strong communication skills, including the ability to explain difficult technical topics, especially causal concepts, to data scientists, engineers, and business partners.

Tools and technologies

SQL, Spark, Python, R, Scala, LLMs, prompt engineering

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• A range of discounted products and free services
• Reimbursement for certain educational expenses (including tuition) for formal education related to advancing your career at Apple
• Discretionary employee stock programs, including eligibility for discretionary restricted stock unit awards and discounted stock purchase through the Employee Stock Purchase Plan (if you voluntarily participate)
• Discretionary bonuses or commission payments (if eligible)
• Relocation (if eligible)

Preferred qualifications

• Proven ability to collaborate effectively across functions and work well in a team.
• Experience managing projects across a range of sizes and scopes, including knowing when to dive deep.
• Experience with methods that address accuracy and variability in human annotation data.
• Ability to learn new technologies and skills as working requirements change.