← All roles

Sr. Software Engineer- AI/ML, Amazon Neuron Training

Amazon· Software Development
Apply on company site
Cupertino$193.3k - $261.5kfull-timePosted 4w ago

About the role

Senior software engineer role focused on building distributed training and post-training support into PyTorch and JAX for AWS Trainium accelerators, enabling large-scale training, RLHF, and related workloads across the Neuron stack with a hardware-software co-design approach.

Responsibilities

  • Lead the effort to build distributed training and post-training support into PyTorch and JAX for Trainium accelerators.
  • Work across PyTorch and Neuron software stack with the Neuron compiler and runtime teams to enable and fine tune large-scale training, post training, and reinforcement learning workloads on the latest Trainium instances.
  • Own the parallelism strategies these models depend on, spanning data, tensor, pipeline, expert, and context parallelism, and apply reduced-precision formats where they measurably pay off.
  • Profile end-to-end to determine whether a workload is bound by compute, memory, collectives, or host overhead, then drive fixes to the responsible layer, collaborating with compiler, runtime, and collectives engineers.
  • Translate performance gaps into requirements that influence frameworks, and contribute upstream to open source frameworks our customers train on.

Qualifications

  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language experience
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience as a mentor, tech lead or leading an engineering team
  • Bachelor's degree or above in computer science or equivalent
  • Familiarity with LLM/transformer fundamentals such as attention mechanisms, autoregressive decoding, V-cache behavior, forms of parallelism
  • Experience in machine learning, data mining, information retrieval, statistics or natural language processing

Skills

Required:Distributed trainingPyTorchJAXLLM/transformer fundamentals

Benefits

  • Health insurance (medical, dental, vision, prescription)
  • Basic Life & AD&D insurance and option for Supplemental life plans
  • EAP, Mental Health Support
  • Flexible Spending Accounts
  • Adoption and Surrogacy Reimbursement coverage
  • 401(k) matching
  • Paid time off
  • Parental leave
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Amazon

Amazon.com, Inc. or its affiliates

liquid-ai-recruiting-target
Company profileWebsite

More open roles at Amazon