AIML - Applied AI Scientist, Image Autograder Systems, Evaluation
Apple· Machine Learning and AI
Cupertino, CA$150.4k - $277.6kunknownPosted 2mo ago
About the role
AI Scientist to join Apple's centralized evaluation organization to build autograders for image generation features. Focus on autograder research, training, and adoption; collaborate with AI feature teams, eval design teams, and annotation teams to refine rubrics, prompts, and gold sets; develop scalable autograding systems and analyze quality.
Responsibilities
- Develop autograders that reliably score image output quality at scale.
- Collaborate with AI feature teams, eval design teams, and annotation teams to refine feature requirements, grading rubrics and gold annotation sets.
- Develop, evaluate, and iterate on grading prompts to align autograder behavior with grading rubrics and gold sets.
- Identify limits of prompt tuning and apply fine-tuning or other techniques to close accuracy gaps.
- Design insightful analyses to measure and explain Autograder quality.
- Collaborate with MLEs and feature teams on autograder deployment and adoption.
- Develop scalable system to speed up autograder training processes.
Qualifications
- Master's or PhD in Computer Science, Machine Learning, Artificial Intelligence, or a related field.
- Deep understanding of visual-language models.
- Familiarity with image quality assessment - perceptual quality dimensions, evaluation metrics, and rubric design.
- Proficiency in Python; capable of writing well-structured, production-ready model code.
- Strong communication skills in explaining autograder quality and driving autograder adoption with partner teams.
Skills
Required:PythonVisual-language modelsImage quality assessmentPrompt tuningFine-tuningCommunicationAutograder conceptsResearch to implementation translation
Benefits
- Apple benefits including comprehensive medical and dental coverage, retirement benefits, discounted products and free services, reimbursement for certain educational expenses, potential discretionary bonuses or commission, relocation assistance.
Last updated Aug 7, 2026. Interested? Apply on the company site.
About Apple
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
More open roles at Apple
- Senior UI Software Engineer, Cocoa2d agoCupertino, CA · Software and Services
- AIML - Machine Learning Engineer, Visual Intelligence Technology2d agoHybrid (Cupertino/Santa Clara/SSeattle area (3 work locations)) · Visual Intelligence Technology
- Physical Design Methodology CAD Engineer2d agoHybrid (Sunnyvale, California), Hybrid (Austin, Texas) +3 more · Hardware Technology CAD team / Silicon Technologies group
- Sr. ML Optimization Engineer, ASE Efficiency2d agoHybrid (San Diego, CA) · Software and Services
- Sr. ML Optimization Engineer, ASE Efficiency2d agoHybrid (Seattle, WA) · Software and Services