← All roles

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference

Apple· Machine Learning and AI
Apply on company site
Hybrid (Seattle, WA), Hybrid (Santa Clara, CA)$175k - $308.5kFull-timePosted 2mo ago

About the role

Senior role focused on building and optimizing production-grade inference systems for large foundation models across language, vision, and speech, with a mix of research collaboration and real-world deployment at planetary scale within Apple’s privacy-preserving Cloud OS & Inference infrastructure.

Responsibilities

  • Partner with the Foundation Model Research team and our external partners to optimize inference for the latest model architectures across language, vision, and speech.
  • Design and ship production-grade inference systems serving millions of customers in real time.
  • Build profiling tools and simulators to identify and resolve performance bottlenecks across different hardware configurations and use cases.
  • Drive technical decisions on high-throughput, low-latency serving at supercomputing scale.
  • Mentor and grow engineers across the organization.

Qualifications

  • 5+ years of experience leading complex, ambiguous technical projects from end to end.
  • Hands-on experience with LLM inference stacks.
  • Working knowledge of GPU or TPU programming concepts.
  • Proficiency with PyTorch, JAX, or TensorFlow.
  • Experience building and operating high-throughput services at large distributed scale.
  • Proficiency deploying applications on cloud platforms (AWS, GCP, or equivalent) using Kubernetes and Docker.
  • BS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.

Skills

Required:Experience leading complex technical projectsLLM inference stacksGPU or TPU programming conceptsPyTorch, JAX, or TensorFlowDistributed systems / high-throughput servicesCloud deployment with Kubernetes and DockerDeep learning architectures including Transformers
Nice to have:Go or Python production systemsInference optimization frameworksCUDA kernels (CUDA C++ or OpenAI Triton)

Benefits

  • Comprehensive medical and dental coverage
  • retirement benefits
  • a range of discounted products and free services
  • reimbursement for certain educational expenses — including tuition
  • discretionary bonuses or commission payments as well as relocation (role may be eligible)
  • participation in Apple shareholder programs via discretionary stock programs
  • employee stock purchase plan
Last updated Oct 9, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple