← All roles

Software Engineer- AI/ML, Amazon Neuron Training

Amazon· Annapurna Labs (U.S.) Inc.
Apply on company site
Cupertino$165.2k - $223.6kFull-timePosted 4w ago

About the role

Software engineer role focused on building and tuning AWS Neuron distributed training components for large-scale ML workloads on Trainium, across PyTorch and Neuron software stack, with emphasis on data, tensor, and pipeline parallelism and performance optimization.

Responsibilities

  • Implement and tune components of the distributed training stack for large-scale training, post-training, and reinforcement learning workloads on the latest Trainium instances, across PyTorch and the Neuron software stack.
  • Contribute to parallelism strategies such as data, tensor, and pipeline parallelism and apply reduced-precision formats under the guidance of senior team members.
  • Profile workloads to identify bottlenecks in compute, memory, collectives, or host overhead, and collaborate with compiler, runtime, and collectives engineers to implement fixes.
  • Build and maintain internal tooling, benchmarks, and tests to keep performance work reproducible, and take on increasing ownership over time.

Qualifications

  • Bachelor's degree or above in computer science or equivalent
  • 3+ years of experience with full software development life cycle in production
  • 3+ years of experience with at least one programming language such as Python, C/C++, or a similar language
  • 2+ years of experience with system design (design patterns, reliability and scaling) of new or existing systems
  • Familiarity with LLM/transformer fundamentals such as attention mechanisms, autoregressive decoding, KV-cache behavior, and various forms of parallelism

Skills

Required:Distributed training stack experienceC/C++ or Python
Nice to have:PyTorch/JAX

Benefits

  • Health insurance (medical, dental, vision, prescription)
  • Basic Life & AD&D insurance and option for Supplemental life plans
  • EAP, Mental Health Support, Medical Advice Line
  • Flexible Spending Accounts
  • Adoption and Surrogacy Reimbursement coverage
  • 401(k) matching
  • Paid time off
  • Parental leave
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Amazon

Amazon.com, Inc. or its affiliates

liquid-ai-recruiting-target
Company profileWebsite

More open roles at Amazon