DataJobs.io
← Back to all jobs

Job Description

Apple’s DAQ team is seeking an AI Engineer focused on algorithm evaluation and agentic systems for advanced computer vision and video understanding. In this role, you will help lead benchmarking and integration of state-of-the-art image and video models, then rigorously test them in applied settings to surface real-world risks and improve reliability.

You’ll combine deep computer vision and machine learning knowledge with evaluation rigor, designing frameworks that generate meaningful metrics. The work also extends into architecting agentic systems for robust evaluation and production workflows, contributing to how Apple’s next-generation AI products perform with safety and intelligence in mind.

What you’ll do

  • Lead the benchmarking and integration of state-of-the-art models for image and video understanding.
  • Use deep CV and ML expertise to rigorously test models in applied settings.
  • Identify edge-case failure modes and uncover hallucinations and performance bottlenecks in constrained environments.
  • Architect advanced agentic systems.
  • Contribute to approaches that help ensure next-generation AI products are robust, safe, and truly intelligent.

Qualifications

  • MS degree and at least 3 years of relevant industry experience.
  • 3+ years of applied experience in Machine Learning, Computer Vision, or AI System Evaluation.
  • Solid ML foundation including core principles of probability, statistics, data distributions, and model bias/variance, with the ability to apply statistical rigor to make evaluation metrics meaningful and reliable.
  • Computer Vision expertise with deep theoretical and practical understanding of CV and Vision-Language Models (VLMs), including how Vision Transformers (ViTs), spatial-temporal modeling, and image/video processing work.
  • Advanced evaluation skills including defining robust metrics and KPIs for generative AI or foundation models, creating custom benchmarks, running automated regression testing, using LLM/VLM-as-a-judge methodologies, and performing human-in-the-loop evaluation.
  • Agentic systems experience building and evaluating LLM/VLM-powered agents with tool use, multi-step reasoning, planning, and memory management workflows.
  • Failure analysis strengths for probing models, translating findings into actionable improvement recommendations.
  • Engineering excellence with strong proficiency in Python and experience using PyTorch to run inference, extract embeddings, and build scalable evaluation pipelines.

Technologies

  • Python
  • PyTorch
  • Vision Transformers (ViTs)
  • LLM/VLM-as-a-judge methodologies
  • Vision-Language Models (VLMs)

Benefits

  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Discounted products and free services
  • Reimbursement for certain educational expenses, including tuition
  • Discretionary bonuses or commission payments and relocation (if eligible)
  • Opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs
  • Eligible for discretionary restricted stock unit awards
  • Ability to purchase Apple stock at a discount via the Employee Stock Purchase Plan

Location: Sunnyvale, CA (onsite). Compensation: USD 150,400 - 277,600 per year.

Similar Jobs