← All roles

Systems Engineer - Evaluation Engineering

Apple· Machine Learning and AI
Apply on company site
Cupertino, CaliforniaFull-timePosted 3d ago

About the role

Distributed Systems Engineer to own and design the infrastructure powering Siri Agentic Evaluation Platform. Focus on a deterministic, fault-tolerant, and cost-efficient execution engine that coordinates massive parallel evaluation loops across heterogeneous devices, with self-service tooling, robust APIs, and end-to-end observability.

Responsibilities

  • Distributed Execution Engine: Architect and scale the core asynchronous engine responsible for orchestrating thousands of parallel agent simulations, validation tests, and LLM-as-a-judge pipelines.
  • Internal Developer Platform (IDP): Design and build self-service infrastructure, CLI tools, and internal APIs that allow ML and product teams to easily integrate evaluation pipelines into their CI/CD workflows.
  • Backend API & Service Architecture: Design, build, and maintain highly performant, type-safe APIs (gRPC/REST) capable of serving complex evaluation pipelines, trace data, and real-time generation metrics.
  • Stream Processing & Lineage: Build robust data pipelines to ingest and transform high-volume execution traces, ensuring immutable data lineage for granular error attribution.
  • Infrastructure-as-Code & GitOps: Own deployment topologies across multi-tenant clusters using declarative infrastructure and continuous delivery practices.
  • Reliability, Observability & Guardrails: Implement deep observability (distributed tracing, metrics, alerting) and design scheduling layers, token buckets, and circuit breakers to prevent failures.

Qualifications

  • MS in computer science or equivalent
  • 7+ years of experience as distributed systems engineer, platform engineer or equivalent.
  • Strong proficiency in Python (asyncio) or Java.
  • Deep expertise in designing robust, versioned production APIs using gRPC/Protobuf, GraphQL, or REST (FastAPI).
  • Advanced experience with Kubernetes (custom operators, service meshes like Istio or Linkerd) and cloud providers (AWS, GCP, or Azure).
  • Relational & Analytical Databases: PostgreSQL with high-throughput analytical queries.
  • Orchestration & Messaging: Kafka, AWS SQS/SNS, RabbitMQ, or Redis Streams.
  • Experience building Agentic RAG platforms or developer-facing infrastructure tooling.
  • Infrastructure-as-Code (IaC): Terraform.
  • CI/CD & DevEx: Automated, containerized deployment pipelines (GitHub or ArgoCD).

Skills

Required:Distributed systems designAPI design and ecosystemsCloud native/KubernetesData engineering and lineageIaC (Terraform)CI/CD tooling

Benefits

  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Discounted products and free services
  • Educational expense reimbursement (tuition)
  • Potential discretionary bonuses or commission payments
  • Relocation support (may be eligible)
  • Employee Stock Purchase Plan and stock-based incentives
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple