← All roles

Software Engineer - Evaluation Engineering

Apple· Siri / Apple Intelligence
Apply on company site
Cupertino, CA$150.4k - $225.3kFull-timePosted 2mo ago

About the role

Software Engineer to build the foundational on-device execution harness and runtime infrastructure for agentic evaluation within the Siri/Apple Intelligence organization. Focused on deterministic on-device execution of multi-step agent trajectories across Apple hardware, including harnesses, environment control, and trace collection to evaluate agentic reasoning, tool use, on-screen awareness, and personal context actions.

Responsibilities

  • Architect and build high-reliability execution harnesses to drive dynamic, multi-step agentic trajectories and tool interactions directly on target Apple hardware (iOS, macOS, watchOS, visionOS).
  • Implement lightweight, and event-capture layers to record high-fidelity execution traces (tool inputs/outputs, state mutations, and runtime events) for downstream scoring and analysis.
  • Build CLI tools, local automation scripts, and integration hooks that allow software and ML teams to run on-device agent harnesses seamlessly within local development environments and continuous testing pipelines.
  • Optimize harness performance and resource overhead, ensuring test execution remains stable and lightweight without interfering with on-device AI runtime behavior, thermal limits, or memory profiles.

Qualifications

  • Strong programming proficiency in compiled languages (Swift, C++, or Objective-C).
  • Excellent communication skills and ability to collaborate across teams.
  • Scripting and automation skills in Python for tooling.
  • B.S. or M.S. in Computer Science, Machine Learning, or equivalent experience.
  • Solid computer science and systems fundamentals, including process management, and local runtimes.

Skills

Required:SwiftC++PythonOS/runtime fundamentals
Nice to have:Objective-CTelemetry/trace infrastructureOn-device AI/LLM runtimes

Benefits

  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Discounted products and free services
  • Educational reimbursement (including tuition)
  • Discretionary bonuses or commissions (potential) and relocation support
Last updated Aug 14, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple