← All roles

AIML - Applied AI Scientist, Image Autograder Systems, Evaluation

Apple· Machine Learning and AI
Apply on company site
Cupertino, CA$150.4k - $277.6kunknownPosted 2mo ago

About the role

AI Scientist to join Apple's centralized evaluation organization to build autograders for image generation features. Focus on autograder research, training, and adoption; collaborate with AI feature teams, eval design teams, and annotation teams to refine rubrics, prompts, and gold sets; develop scalable autograding systems and analyze quality.

Responsibilities

  • Develop autograders that reliably score image output quality at scale.
  • Collaborate with AI feature teams, eval design teams, and annotation teams to refine feature requirements, grading rubrics and gold annotation sets.
  • Develop, evaluate, and iterate on grading prompts to align autograder behavior with grading rubrics and gold sets.
  • Identify limits of prompt tuning and apply fine-tuning or other techniques to close accuracy gaps.
  • Design insightful analyses to measure and explain Autograder quality.
  • Collaborate with MLEs and feature teams on autograder deployment and adoption.
  • Develop scalable system to speed up autograder training processes.

Qualifications

  • Master's or PhD in Computer Science, Machine Learning, Artificial Intelligence, or a related field.
  • Deep understanding of visual-language models.
  • Familiarity with image quality assessment - perceptual quality dimensions, evaluation metrics, and rubric design.
  • Proficiency in Python; capable of writing well-structured, production-ready model code.
  • Strong communication skills in explaining autograder quality and driving autograder adoption with partner teams.

Skills

Required:PythonVisual-language modelsImage quality assessmentPrompt tuningFine-tuningCommunicationAutograder conceptsResearch to implementation translation

Benefits

  • Apple benefits including comprehensive medical and dental coverage, retirement benefits, discounted products and free services, reimbursement for certain educational expenses, potential discretionary bonuses or commission, relocation assistance.
Last updated Aug 7, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11

More open roles at Apple