← All roles

Software Engineer- AI/ML, Amazon Neuron Training

Amazon· Annapurna Labs (U.S.) Inc./AWS Neuron Training team
Apply on company site
Cupertino$165.2k - $223.6kFull-timePosted 2w ago

About the role

Software engineer role focusing on distributed training for AWS Neuron on Trainium accelerators. Build and tune distributed training solutions across PyTorch and Neuron stack, with emphasis on data/tensor/pipeline parallelism, profiling, and performance optimization in ML workloads.

Responsibilities

  • Implement and tune components of the distributed training stack for large-scale training, post-training, and reinforcement learning workloads on Trainium instances, across PyTorch and the Neuron software stack
  • Contribute to parallelism strategies (data, tensor, pipeline) and apply reduced-precision formats under guidance
  • Profile workloads to identify bottlenecks in compute, memory, collectives, or host overhead
  • Collaborate with compiler, runtime, and collectives engineers to land fixes
  • Build and maintain internal tooling, benchmarks, and tests to keep performance work reproducible
  • Take on increasing ownership as you grow in the role

Qualifications

  • Bachelor's degree or above in computer science or equivalent
  • 2+ years of designing or architecting scalable systems
  • 3+ years of full software development lifecycle experience in production
  • 3+ years of experience with Python, C/C++, or similar language
  • Familiarity with LLM/transformer fundamentals (attention, autoregressive decoding, KV-cache, forms of parallelism)

Skills

Required:Distributed trainingParallelism (data/tensor/pipeline)Profiling and performance engineeringPythonC/C++
Nice to have:PyTorch/JAX

Benefits

  • Base salary range listed: USA, CA, Cupertino 165,200.00 - 223,600.00 USD annually
  • Sign-on payments and restricted stock units (RSUs)
  • Comprehensive benefits including health insurance (medical, dental, vision, prescription, life & AD&D options, EAP, mental health support, FSA, adoption and surrogacy reimbursement)
  • 401(k) matching
  • Paid time off and parental leave
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Amazon

Amazon.com, Inc. or its affiliates

liquid-ai-recruiting-target
Company profileWebsite

More open roles at Amazon