← All roles

Siri Quality Engineer

Apple· Software and Services
Apply on company site
BeijingFull-timePosted 1w ago

About the role

Software Quality Engineer focused on elevating the quality of Siri features and intelligent services in Mainland China. Combines traditional QA with Generative AI/LLM evaluation, builds automation tools, and drives end-to-end quality across the lifecycle.

Responsibilities

  • End-to-End Quality Ownership: Drive test strategies, comprehensive test plans, design reviews, and quality execution to ensure new Siri capabilities and services ship with exceptional quality to delight our customers.
  • LLM & AI Evaluation: Design rigorous evaluation schemes, curated benchmark datasets, adversarial/negative samples, and edge cases across conversational AI, RAG, tool-use/agents, and multimodal scenarios.
  • AI-Empowered Tooling & Automation: Leverage Generative AI and modern automation technologies to develop internal tools, intelligent test generation pipelines, and self-healing test frameworks to boost operational velocity and daily engineering productivity.
  • Quality Metrics & Bad Case Closed-Loop: Define model quality metrics and monitoring dashboards. Systematically collect, categorize, and diagnose failure modes (e.g., hallucinations, tool invocation errors, retrieval failures, prompt deficiencies) and partner with modeling and product teams to drive continuous improvement.
  • Deep Troubleshooting & Root-Cause Analysis: Investigate and troubleshoot complex, ambiguous issues across multiple layers, including client applications, cloud backend services, APIs, telemetry/logs, and AI model behaviors.
  • Safety & Compliance: Support evaluations for content safety, privacy, bias, and responsible AI risks to maintain high standards for user trust and compliance.
  • Cross-Functional Collaboration: Partner closely with engineering, product, localization, and cross-site teams to instill quality best practices throughout the software development lifecycle.

Qualifications

  • BS/MS in Computer Science, Computer Engineering, or equivalent practical experience.
  • Strong proficiency in at least one modern programming or scripting language (e.g., Python, Swift, Java, Go), with solid fundamentals in data structures, databases, SQL, and OS environments (Unix/Linux/macOS).
  • Hands-on experience architecting and implementing test automation frameworks for client-side applications, backend services, and end-to-end integration flows.
  • Experience with CI/CD pipelines, containerization, and modern cloud/distributed infrastructure.
  • Solid understanding of Generative AI / LLM concepts, with proven ability to build tools, scripts, or workflows utilizing model APIs.
  • Strong analytical, logical, and debugging skills: capable of breaking down complex, ambiguous problems into testable hypotheses and investigating issues across diverse technical stacks.
  • High adaptability and resilience to navigate rapidly shifting priorities in a fast-paced environment.
  • Strong communication and interpersonal skills, with the ability to collaborate effectively across multi-functional and geographically distributed teams.
  • Professional working proficiency in both written and spoken English and Mandarin.

Skills

Required:Programming / ScriptingTest AutomationCI/CD / CloudGenerative AI / LLMProblem Solving / DebuggingCommunicationLanguages
Last updated Oct 16, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple