← All roles

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference

Apple· Cloud OS and Private Cloud Compute (PCC)
Apply on company site
Hybrid (Paris)full-timePosted 1mo ago

About the role

Role focused on building and optimizing production-grade inference systems for foundation models at planetary scale, collaborating with Foundation Model Research and external partners, and delivering high-throughput, low-latency, privacy-preserving inference on Apple’s infrastructure.

Responsibilities

  • Partner with the Foundation Model Research team and our external partners to optimise inference for the latest model architectures across language, vision, and speech.
  • Design and ship production-grade inference systems serving millions of customers in real time.
  • Build profiling tools and simulators to identify and resolve performance bottlenecks across different hardware configurations and use cases.
  • Drive technical decisions on high-throughput, low-latency serving at supercomputing scale.
  • Mentor and grow engineers across the organisation.

Qualifications

  • Experience leading complex ambiguous Machine learning projects end to end.
  • Proficiency in PyTorch or JAX
  • Experience working with Inference frameworks
  • Experienced in Python / Rust / Go lang or similar programming languages
  • Proficiency in deploying applications on cloud platforms (AWS, GCP or equivalent) using K8S and docker.

Skills

Required:Machine learning project leadershipPyTorch or JAXInference frameworksProgramming languagesCloud deploymentDistributed systemsDeep learning architectures
Nice to have:LLM inference stacksGPU/TPU programmingInference optimization frameworks

Benefits

  • Not specified in the provided description (see original posting for benefits on Apple’s careers page)
Last updated Sep 4, 2026. Interested? Apply on the company site.

About Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
Company profileWebsite

More open roles at Apple