ML Compiler Engineer, Neuron Kernel Interface
Amazon· Annapurna Labs (U.S.) Inc.
Hybrid (Seattle, WA), Hybrid (Cupertino, CA)$143.7k - $194.4kFull-timePosted 1w ago
About the role
AWS ML compiler engineer focusing on the Neuron Kernel Interface (NKI) compiler for AWS Trainium, designing and shipping compiler features, working with PyTorch/JAX workloads, and collaborating with hardware and ML teams to optimize performance on Trainium.
Responsibilities
- Design and build compiler features for the Neuron compilers. Your work may span the frontend, intermediate representations, optimization passes, and code generation for the hardware.
- Own features from design through production: design, implement, test on hardware and simulation, and support customers.
- Work with Amazon ML teams (PyTorch, JAX, and internal model teams) to understand their workloads and unblock them.
- Give hardware teams compiler and programmability feedback on upcoming chips.
- Review code and designs, and mentor newer engineers.
Qualifications
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 1+ years of software development engineer or related occupational experience
- 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
- 1+ years of Object Oriented Design experience
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
- Experience programming with at least one software programming language
Skills
Required:Compiler design and implementationHardware/software integrationCollaboration with ML frameworks (PyTorch, JAX)
Benefits
- Health insurance (medical, dental, vision, prescription)
- Basic Life & AD&D insurance and option for Supplemental life plans
- EAP, Mental Health Support, Medical Advice Line
- Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave
Last updated Oct 25, 2026. Interested? Apply on the company site.
More open roles at Amazon
- IT Support Associate II, Ops Tech Solutions (OTS)yesterdayPlainfield, Indiana · Operations IT Support Engineering
- Head of Energy and Water, AWS LegalyesterdayHybrid (Seattle, WA) · Legal
- Software Development Engineer, Creative Asset Library, CreativeXyesterdaySeattle · Software Development
- Software Development Engineer, Creative Asset Library, CreativeXyesterdayHybrid (Seattle, WA) · Software Development
- IT Support Associate II, OTSyesterdayIrving, TX · Operations IT Support Engineering