← All roles

Software Development Engineer in Test, Siri AI QE

Apple· Siri AI Quality Engineering
Apply on company site
Hybrid (Yokohama)Full-timePosted 3w ago

About the role

Siri AI Quality Engineering role focused on end-to-end quality for Siri across Apple devices. Responsible for shaping quality strategy, designing robust test automation and agentic testing solutions, and validating real-device ecosystems from design to release.

Responsibilities

  • Feature Quality Ownership (DRI): End-to-end Quality DRI for key Siri capabilities, shaping quality strategy, test architecture, risk assessment, and go/no-go shipping criteria across platforms from design to release.
  • Pragmatic Automation & Harness Architecture: Design, build, and maintain robust test automation in Python and Swift/XCTest. Architect shared test harnesses and dynamic execution pipelines integrated into CI/CD.
  • Agentic Test Solutions: Architect and deploy agentic testing solutions (tool-calling loops, multi-agent evaluation, dynamic state exploration) to validate complex, multi-turn, contextual Siri interactions that traditional scripts cannot adequately test.
  • Engineering Judgment: Determine when to write deterministic, maintainable code versus leveraging LLM-driven agents and evals.
  • Real-Device & Ecosystem Validation: Oversee testing across iPhone, iPad, Mac, Apple Watch, and Vision Pro, validating system states, sensor inputs, connectivity, and on-device intelligence.
  • Triage & Cross-Functional Alignment: Triage complex failure modes across ML models, OS frameworks, and client apps; drive root-cause isolation, land fixes, and report quality metrics.

Qualifications

  • Bachelor's or Master’s degree in Computer Science or related field.
  • 8+ years of experience in software development or test engineering with leadership as a Feature DRI or Quality Lead.
  • Strong programming fundamentals in Python and/or Swift (or Objective-C/C++); experience in modular test harnesses, CLI tools, and automated pipelines.
  • Hands-on experience with GenAI / Agentic systems: LLM orchestration, tool/function calling, prompt engineering, and agent execution harnesses.
  • Deep understanding of test engineering: test planning, risk-based testing, parameterized frameworks, dynamic test generation, CI/CD automation.
  • Experience with physical device testing and hardware/software integration across varied OS configurations.
  • Strong organizational and communication skills; proactive cross-regional coordination and clear quality signal reporting.
  • Experience designing evaluation frameworks for non-deterministic AI systems: golden datasets, LLM-as-a-judge pipelines, rubric design, semantic similarity scoring, and regression/drift detection.
  • Familiarity with Apple platforms (Xcode, XCTest, macOS/iOS internals).
  • Experience developing autonomous exploratory testing agents or autoresearch/eval loops to surface edge cases.

Skills

Required:PythonSwiftGenAI / Agentic Systems

Benefits

  • Apple is an equal opportunity employer committed to inclusion and diversity.
  • Reasonable accommodation for applicants with disabilities.
  • Accessibility commitment reflected in workplace and benefits.
Last updated Oct 2, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple