← All roles

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference

Apple· Machine Learning and AI
Apply on company site
Santa Clara, California, Seattle, Washington$184.7k - $324.8kFull-timePosted 2mo ago

About the role

Senior role within the Foundation Model Inference team focused on building and optimizing high-performance, secure inference systems for foundation models at scale across Apple services. Combines research and production to deliver low-latency, privacy-preserving inference on Apple’s Cloud OS and Private Cloud Compute infrastructure.

Responsibilities

  • Partner with the Foundation Model Research team and our external partners to optimize inference for the latest model architectures across language, vision, and speech.
  • Design and ship production-grade inference systems serving millions of customers in real time.
  • Build profiling tools and simulators to identify and resolve performance bottlenecks across different hardware configurations and use cases.
  • Drive technical decisions on high-throughput, low-latency serving at supercomputing scale.
  • Mentor and grow engineers across the organization.

Qualifications

  • 5+ years of experience leading complex, ambiguous technical projects from end to end.
  • Hands-on experience with LLM inference stacks.
  • Working knowledge of GPU or TPU programming concepts.
  • Proficiency with PyTorch, JAX, or TensorFlow.
  • Experience building and operating high-throughput services at large distributed scale.
  • Proficiency deploying applications on cloud platforms (AWS, GCP, or equivalent) using Kubernetes and Docker.
  • BS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.

Skills

Required:LLM inferenceGPU/TPU programmingPyTorch, JAX, or TensorFlow
Nice to have:Go or Python

Benefits

  • Comprehensive medical and dental coverage
  • retirement benefits
  • discounted products and free services
  • reimbursement for certain educational expenses including tuition
  • discretionary bonuses or commission payments and relocation may be available
  • stock programs including discretionary RSUs and Employee Stock Purchase Plan
Last updated Oct 9, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple