Machine Learning System Software Engineer
Apple· Hardware
Sunnyvale, CA$184.7k - $324.8kFull-timePosted 2mo ago
About the role
Machine Learning System Software Engineer on the Apple Neural Engine (ANE) team at Apple, focusing on high-performance, low-power AI solutions across devices. Role involves designing runtimes, APIs, and system software that enable on-device model loading, compilation, scheduling, and execution, with opportunities for technical leadership and cross-team collaboration.
Responsibilities
- Design and implement API's for Apple's Neural Engine - defining how clients load, compile, schedule and execute models on device
- Architect APIs which provide client control of model lifecycle management, memory allocation strategies, multi-model scheduling, and concurrent execution — ensuring the runtime scales with new hardware capabilities
- Collaborate deeply with driver, firmware and compiler teams to co-design the runtime-to-silicon interface, ensuring new hardware features are exposed with correct abstractions
- Profile and optimize end-to-end inference paths, identifying bottlenecks in scheduling, compilation, and inference execution
- Support clients in adopting APIs and ensuring efficient integration
Qualifications
- BS and a minimum of 10 years relevant industry experience
- Experience defining interfaces that are used by other teams or external developers, with attention to lifecycle, error handling, and forward compatibility
- Deep proficiency in C and C++ in large, production system software
- Understanding of runtime systems: process/thread models, memory management, IPC/RPC, and resource lifecycle
- Understanding of software-hardware interfaces: registers, DMA, command queues, or similar accelerator interaction patterns
- Experience shipping production system software
Skills
Required:API design for ML runtimesC and C++Runtime systemsSoftware-hardware interfacesML runtimes / inference engines
Nice to have:Swift/Rust familiarityML model compilation pipelines
Benefits
- Apple benefits including comprehensive medical and dental coverage, retirement benefits, discounted products and free services, reimbursement for certain educational expenses including tuition
- Discretionary employee stock programs and Employee Stock Purchase Plan
- Potential for discretionary bonuses or commission payments and relocation eligibility
Last updated Aug 14, 2026. Interested? Apply on the company site.
About Apple
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.
AirPods Max 2Apple ArcadeApple CardApple Fitness+Apple MusicApple TVApple TV+Apple Watch Series 11
More open roles at Apple
- Senior UI Software Engineer, Cocoa2d agoCupertino, CA · Software and Services
- AIML - Machine Learning Engineer, Visual Intelligence Technology2d agoHybrid (Cupertino/Santa Clara/SSeattle area (3 work locations)) · Visual Intelligence Technology
- Physical Design Methodology CAD Engineer2d agoHybrid (Sunnyvale, California), Hybrid (Austin, Texas) +3 more · Hardware Technology CAD team / Silicon Technologies group
- Sr. ML Optimization Engineer, ASE Efficiency2d agoHybrid (San Diego, CA) · Software and Services
- Sr. ML Optimization Engineer, ASE Efficiency2d agoHybrid (Seattle, WA) · Software and Services