← All roles

Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

Amazon· Annapurna Labs (U.S.) Inc.
Apply on company site
Hybrid (Cupertino, CA)$193.3k - $261.5kFull-timePosted 1mo ago

About the role

Role focused on designing and optimizing high-performance ML kernels for AWS Neuron accelerators (Inferentia and Trainium), working across compiler, runtime, framework, and hardware teams to maximize ML workload performance on AWS accelerators.

Responsibilities

  • Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
  • Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
  • Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
  • Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
  • Work directly with customers to enable and optimize their ML models on AWS accelerators
  • Collaborate across teams to develop innovative kernel optimization techniques

Qualifications

  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language experience
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Experience as a mentor, tech lead or leading an engineering team

Skills

Required:Kernel design and optimizationPerformance analysis and profilingCompiler optimizations (fusion, sharding, tiling, scheduling)
Nice to have:ML frameworks exposure (PyTorch, TensorFlow)

Benefits

  • Health insurance (medical, dental, vision, prescription) and life & AD&D insurance with optional supplemental life plans
  • EAP, Mental Health Support, Medical Advice Line
  • Flexible Spending Accounts
  • Adoption and Surrogacy Reimbursement coverage
  • 401(k) matching
  • Paid time off
  • Parental leave
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Amazon

Amazon.com, Inc. or its affiliates

liquid-ai-recruiting-target
Company profileWebsite

More open roles at Amazon