← All roles

Sr. Software Engineer- AI/ML, AWS Neuron

Amazon
Apply on company site
Seattle, WA$168.1k - $227.4kfull-timePosted 1mo ago

About the role

Senior software engineer on the Machine Learning Applications team at AWS Neuron, building and optimizing AI model acceleration on Amazon's Inferentia and Trainium accelerators. Focus on distributed inference for PyTorch, low-level kernels, performance tuning, and collaboration across compiler, runtime, framework, and hardware teams.

Responsibilities

  • Design, develop, and optimize machine learning models including GPT, Kimi, and Qwen on custom AI accelerators.
  • Participate in all stages of the ML system development lifecycle including distributed computing based architecture design, implementation, performance profiling, low level optimizations, and production deployment.
  • Build infrastructure to systematically analyze and onboard multiple models with diverse architecture.
  • Design and implement high-performance kernels and features for ML operations, leveraging the Neuron architecture and programming models
  • Analyze and optimize system-level performance across multiple generations of Neuron hardware
  • Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
  • Implement optimizations such as fusion, sharding, tiling, and scheduling
  • Work directly with customers to enable and optimize their ML models on AWS accelerators
  • Collaborate across teams to develop innovative optimization techniques
  • Develop kernels to improve model efficiency on Amazon AI Accelerators
  • Transform complex tensor operations into highly optimized graph implementations
  • Optimize state-of-the-art language, vision, and multimodal generative AI models for Neuron hardware
  • You will collaborate with a cross-functional team of applied scientists, system engineers, and product managers to deliver state-of-the-art inference capabilities for Generative AI applications.
  • Your work will involve debugging performance issues, optimizing memory usage, and shaping the future of Neuron's inference stack across Amazon and the Open Source Community.
  • As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects.
  • You will also build high-impact solutions to deliver to our large customer base and participate in design discussions, code review, and communicate with internal and external stakeholders.
  • You will work cross-functionally to help drive business decisions with your technical input.
  • You will work in a startup-like development environment, where you’re always working on the most important initiative.

Qualifications

  • Bachelor's degree
  • 5+ years of non-internship professional software development experience
  • Knowledge of Python and/or C++ programming
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience in debugging, profiling, and implementing software engineering best practices in large-scale systems
  • Knowledge of system performance, memory management, and parallel computing principles
  • Experience owning a performance optimization roadmap and mentoring engineers on optimization

Skills

Required:Python programmingC++ programmingDistributed systemsPerformance optimization

Benefits

  • health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
  • 401(k) matching
  • paid time off
  • parantal leave
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Amazon

Amazon.com, Inc. or its affiliates

liquid-ai-recruiting-target
Company profileWebsite

More open roles at Amazon