AIML - Manager, Applied AI Science - LLM/VLM-as-a-judge
Apple· Machine Learning and AI
Cupertino, CA$206.2k - $356.4kfull-timePosted 3d ago
About the role
Manager to lead a team of Applied AI Scientists developing AI/ML models for automatic grading and quality assessment of internal GenAI products. Define technical direction for autograding at Apple, grow the team, and partner across the company to enable trustworthy automated evaluation for AI product teams.
Responsibilities
- Lead and grow a high-performing team of applied AI scientists and machine learning engineers, including hiring, talent development, performance management, and building a strong technical leadership layer.
- Set the technical vision and roadmap for autograder development, evaluation methodology, and toolings.
- Deliver reliable, scalable LLM/VLM-based evaluation systems that can be trusted for product-quality decisions.
- Navigate complex technical and organizational challenges, resolve cross-functional dependencies, and sustain alignment across organizations.
- Identify opportunities to standardize and automate the end-to-end evaluation workflow, enabling the team to scale beyond bespoke autograder development.
Qualifications
- MS/PhD degree in Computer Science, Machine Learning, AI, or a related field.
- 1+ years of industry experience building LLM/VLM-based evaluators, autograders, or automated evaluation systems.
- 5+ years of hands-on experience in machine learning, model alignment, or benchmark creation.
- Track record of managing teams of 3+ machine learning engineers and/or AI scientists.
- Deep understanding of GenAI models and their evaluation methodologies, including rubric design, evaluation set development, validation, calibration, and human-model alignment.
Skills
Required:Team leadership and managementAutograding / evaluation system designGenAI model evaluation
Benefits
- Comprehensive medical and dental coverage
- retirement benefits
- range of discounted products and free services
- reimbursement for certain educational expenses including tuition
- potential discretionary bonuses or commission payments
- relocation assistance
- Apple shareholder opportunities through stock programs
- Employee Stock Purchase Plan
Last updated Oct 23, 2026. Interested? Apply on the company site.
About Apple
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
More open roles at Apple
- Senior UI Software Engineer, Cocoa3d agoCupertino, CA · Software and Services
- AIML - Machine Learning Engineer, Visual Intelligence Technology3d agoHybrid (Cupertino/Santa Clara/SSeattle area (3 work locations)) · Visual Intelligence Technology
- Physical Design Methodology CAD Engineer3d agoHybrid (Sunnyvale, California), Hybrid (Austin, Texas) +3 more · Hardware Technology CAD team / Silicon Technologies group
- Sr. ML Optimization Engineer, ASE Efficiency3d agoHybrid (San Diego, CA) · Software and Services
- Sr. ML Optimization Engineer, ASE Efficiency3d agoHybrid (Seattle, WA) · Software and Services