AIML - Sr Data Scientist, Evaluation
About the role
Senior data scientist focused on measurement and evaluation to guide product development and decisions across Apple’s user-facing products. Partners with engineering teams to improve search quality, guide feature development, and translate methodological developments into production evaluation tools and pipelines. Works with large datasets to solve non-routine analysis problems, including prompt engineering and building LLMs as judges.
Responsibilities
- Research and develop evaluation methods to improve the quality of Apple user facing products, such as Siri and Apple Intelligence.
- Work with evaluation/experimentation engineering teams to get methodological developments translated into technologies used by product engineering.
- Work with large, complex data sets.
- Solve difficult, non-routine analysis problems, applying advanced analytical methods as needed, including prompt engineering and building LLMs as judges.
- Conduct analysis that includes data collection and quality control, requirements specification, processing and presentations.
- Build and prototype analysis pipelines iteratively to provide insights at scale.
- Develop comprehensive knowledge of product data structures and metrics, advocating for changes where needed for product development.
- Partner closely with product engineering teams on core machine learning algorithms and user experience evaluations.
Qualifications
- 5 years of relevant work experience.
- Advanced degree in a quantitative field (Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics, or similar).
- Proficiency in data science, machine learning, and analytics, including statistical data analysis.
- Experience crafting, conducting, analyzing, and interpreting experiments and investigations, especially on data quality, evaluation and risk assessment.
- Strong programming skills, including data-querying skills (SQL and/or Spark, etc.) and experience with a scripting language for data processing and development (e.g., Python, R, or Scala).
- Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data.
- Strong communication skills and the ability to explain difficult technical topics (especially causal topics) to diverse audiences.
- Proven ability to collaborate effectively across functions and work well within a team.
- Capable of driving projects of varying sizes and scopes.
- Worked with methods addressing accuracy and variability in human annotation data.
- Ability to learn new technology and skills to accommodate changing working requirements.
Skills
Benefits
- Comprehensive medical and dental coverage
- retirement benefits
- range of discounted products and free services
- reimbursement for certain educational expenses (tuition)
- discretionary bonuses or commission payments as well as relocation (role may be eligible)
- Apple shareholder opportunities through discretionary employee stock programs
- discounted Apple stock through Employee Stock Purchase Plan
About Apple
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
More open roles at Apple
- Senior UI Software Engineer, Cocoa3d agoCupertino, CA · Software and Services
- AIML - Machine Learning Engineer, Visual Intelligence Technology3d agoHybrid (Cupertino/Santa Clara/SSeattle area (3 work locations)) · Visual Intelligence Technology
- Physical Design Methodology CAD Engineer3d agoHybrid (Sunnyvale, California), Hybrid (Austin, Texas) +3 more · Hardware Technology CAD team / Silicon Technologies group
- Sr. ML Optimization Engineer, ASE Efficiency3d agoHybrid (San Diego, CA) · Software and Services
- Sr. ML Optimization Engineer, ASE Efficiency3d agoHybrid (Seattle, WA) · Software and Services