← All roles

Software Development Engineer, Neuron Collectives, Annapurna Labs

Amazon· Software Development
Apply on company site
Cupertino$165.2k - $223.6kfull-timePosted yesterday

About the role

Software Engineer to optimize collective operations for AWS Trainium, focusing on Neuron Collectives to scale AI training compute across data centers through C/C++ implementations, hardware-software co-optimization, and analysis using Neuron Explorer.

Responsibilities

  • Enhance collective algorithms and topologies for optimal training performance
  • Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization
  • Monitor and analyze processor, DMA, firmware, and workload metrics
  • Optimize collective operations to scale AI compute across the data center
  • Work closely with the hardware team to co-optimize software and Trainium silicon
  • Develop and optimize C/C++ implementations of collective communication patterns
  • Investigate and implement improvements for specific training topologies used by modern LLMs
  • Build and maintain analysis frameworks and automation solutions

Qualifications

  • Bachelor's degree in computer science or equivalent
  • Experience building complex software systems that have been successfully delivered to customers
  • Experience contributing to the architecture and design of new and current systems
  • Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
  • Experience in development in the last 3 years, or experience in embedded development in C/C++

Skills

Required:C/C++ programmingPerformance analysis
Nice to have:Neural network training concepts (collectives)

Benefits

  • Health insurance (medical, dental, vision, prescription)
  • Basic Life & AD&D insurance and option for Supplemental life plans
  • Employee Assistance Program (EAP) and Mental Health Support
  • Flexible Spending Accounts
  • Adoption and Surrogacy Reimbursement coverage
  • 401(k) matching
  • Paid time off
  • Parental leave
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Amazon

Amazon.com, Inc. or its affiliates

liquid-ai-recruiting-target
Company profileWebsite

More open roles at Amazon