← All roles

Staff/Sr. ML Infrastructure Engineer, Foundation Model Compute Infra

Apple· Machine Learning and AI
Apply on company site
Hybrid (Seattle; Cupertino; Santa Clara)$175k - $308.5kFull-timePosted 2mo ago

About the role

Senior/Staff Engineer designing and building large-scale infrastructure for foundation model training, fine-tuning, evaluation, and inference. Develop model inference and fine-tuning services, onboard and benchmark accelerators, and collaborate with researchers and engineers to enhance reliability, performance, and scalability of Apple’s AI workloads.

Responsibilities

  • Design, build, and evolve large-scale model serving and fine-tuning services for foundation model workloads
  • Develop reliable infrastructure for model deployment, serving autoscaling, traffic management, job execution, container orchestration, and serving performance analysis
  • Improve performance and usability of model serving and fine-tuning workloads by optimizing latency, throughput, availability, accelerator utilization, checkpoint loading, compilation caching, KV-cache-aware routing, and workflows for launching, monitoring, debugging, evaluating, and deploying models
  • Onboard and Benchmark new accelerator technologies into Apple’s compute infrastructure
  • Collaborate with the Apple Foundation Model team to integrate technologies such as Pathways, Ray, and Beam, or expose them as reliable and scalable services
  • Mentor engineers and partner across teams to influence the technical direction of Apple’s foundation model compute infrastructure

Qualifications

  • 5+ years of industry experience building large-scale distributed systems or cloud infrastructure
  • Experience with distributed ML training or inference systems
  • Strong programming skills in Python, Go, C++, or similar systems languages
  • Experience with accelerator infrastructure such as TPU, GPU
  • Experience with Kubernetes, container orchestration, or large-scale cluster management systems
  • Strong communication and collaboration skills across engineering and research teams
  • Bachelor’s degree in Computer Science, Engineering, or related field

Skills

Required:Distributed systems design and implementationDistributed ML training or inferenceProgramming in PythonProgramming in Go or C++Accelerator infrastructure (TPU, GPU)Kubernetes / container orchestrationCommunication and collaboration

Benefits

  • Comprehensive medical and dental coverage
  • retirement benefits
  • discounted products and free services
  • reimbursement for certain educational expenses (tuition)
  • discretionary bonuses or commission payments and relocation (potential)
  • employee stock programs including RSU eligibility and stock purchase plan
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple