← All roles

ML Software Engineer

Apple· Machine Learning and AI
Apply on company site
Seattle, WA$142.3k - $263.3kfull-timePosted 2mo ago

About the role

Engineering the ML-inference stack for Apple Intelligence's Private Cloud Compute, powering generative AI on Apple Silicon in datacenters. Focus on stability, performance, new functionality, and bringing inference to new SoCs and hardware IP across multi-node clusters, with a service-focused production mindset.

Responsibilities

  • Build and evolve the ML inference stack for Private Cloud Compute, ensuring stability and performance.
  • Implement new functionality as it emerges from research, and port/infer on new generations of SoCs and hardware acceleration IP.
  • Write performant and scalable frameworks (primarily in Swift, with C++ bridges) to distribute and coordinate ML inference across acceleration IP blocks and multi-node clusters.
  • Integrate inference code into a full service stack to serve user traffic reliably and efficiently, with emphasis on safe production development, deployment, and monitoring.
  • Collaborate with hardware, product, and research teams across Apple to extend platforms and features.

Qualifications

  • 2 Years practical experience plus Bachelor's degree in Computer Science, Computer Engineering, or a related field — or equivalent practical experience.
  • Experience building large-scale distributed systems that serve ML inference, reason across processes, hosts, and service tiers, and handle model behavior under load.
  • ML performance-centric mindset with ability to reason about latency/throughput trade-offs and model–system co-design needs.
  • Strong in a systems or server language (Python, Go, Rust, Java, C++, or similar); Swift is used but not required for all components.
  • Low-level or close-to-the-metal work (systems programming, performance, or hardware/SoC bring-up).
  • Experience with server-side Swift or RPC/networking stacks (gRPC, Protocol Buffers).
  • Strong debugging and observability instincts (logs, metrics, traces; OpenTelemetry, Splunk; on-call experience; drive incidents to root cause).
  • Depth in ML inference serving optimizations (quantization, sparsity, batching, KV cache, tokenization, GPU acceleration) and related trade-offs.
  • Solid grasp of concurrency, async/streaming, resource lifecycle, and error/cancellation handling; Apple platform experience a bonus.

Skills

Required:Distributed systemsSystems programmingPython/Go/Rust/Java/C++ML inference serving optimizationsConcurrency/async
Nice to have:SwiftgRPC/Protocol BuffersObservability (logs, metrics, traces)

Benefits

  • Discretionary employee stock programs and possible RSU awards
  • Employee Stock Purchase Plan
  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Discounted products and free services
  • Educational expense reimbursement (tuition)
  • Potential discretionary bonuses or commission payments and relocation assistance
  • Reasonable accommodations and accessibility support
Last updated Jul 31, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple