Staff ML Engineer - Ads ML Infrastructure
Apple· Machine Learning Platform
Hybrid (New York City, NY; Cupertino, CA)$184.7k - $324.8kFull-timePosted 3mo ago
About the role
Staff ML Engineer working on the Ads ML Infrastructure within Apple's Ad Platforms; responsible for designing, developing, and operating secure, scalable back-end ML serving platforms and tools to support real-time and batch inference for advertising products, with a strong emphasis on privacy, reliability, and developer experience.
Responsibilities
- Proven track record of designing and operating large-scale, low-latency ML Serving platform supporting real-time and batch inference.
- Experience of model quantization, tensor parallelism, and inference optimizations (e.g ONNX Runtime, TensorRT, vLLM). Actively led evaluation and adoption of such technologies.
- Experience working on distributed systems (e.g Ray, high-throughput RPC systems) to support scalable inference workloads and hybrid online/offline serving patterns.
- Hands-on experience designing and optimizing low-level GPU kernels to maximize hardware utilization, bypass memory bandwidth bottlenecks, and accelerate deep learning primitives.
- Prior experience in advertising industry, federated learning and privacy-preserving ML techniques.
- Recognized as a technical leader and mentor, supports the growth of engineers through code/design reviews, working groups, and internal knowledge sharing.
- Led development of foundational AI/ML platforms and tooling including Feature Stores, Vector DB to accelerate team productivity and model lifecycle management.
- Experience performance tuning & trouble-shooting.
- Passionate about developer experience builds abstractions, automation tools, and reusable components to streamline ML workflows and reduce operational burden.
- Ability to communicate effectively, both written and verbal, with technical and non-technical multi-functional teams.
- Results oriented with a desire to work in a fast-paced and collaborative work environment.
Qualifications
- PhD, MS, or BS in computer science or a related field, with 8+ years of experience in machine learning and strong software engineering skills.
Skills
Required:Real-time and batch ML inferenceModel quantization and inference optimizationDistributed systems
Nice to have:GPU kernel optimization
Benefits
- Comprehensive medical and dental coverage
- retirement benefits
- discounted products and free services
- reimbursement for certain educational expenses, including tuition
- discretionary bonuses or commission payments and relocation opportunities as applicable
- Apple Employee Stock Purchase Plan and discretionary RSU awards
Last updated Oct 23, 2026. Interested? Apply on the company site.
About Apple
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
More open roles at Apple
- Senior UI Software Engineer, Cocoa2d agoCupertino, CA · Software and Services
- AIML - Machine Learning Engineer, Visual Intelligence Technology2d agoHybrid (Cupertino/Santa Clara/SSeattle area (3 work locations)) · Visual Intelligence Technology
- Physical Design Methodology CAD Engineer2d agoHybrid (Sunnyvale, California), Hybrid (Austin, Texas) +3 more · Hardware Technology CAD team / Silicon Technologies group
- Sr. ML Optimization Engineer, ASE Efficiency2d agoHybrid (San Diego, CA) · Software and Services
- Sr. ML Optimization Engineer, ASE Efficiency2d agoHybrid (Seattle, WA) · Software and Services