← All roles

Software Development Engineer II, SageMaker AI Inference

Amazon· Software Development
Apply on company site
Bellevue, WA$143.7k - $194.4kfull-timePosted yesterday

About the role

Software Development Engineer II focused on inference performance optimization, kernel tuning, and LLM serving efficiency for SageMaker AI inference at Amazon. Hands-on role across the full software development lifecycle to reduce latency and improve throughput for production inference workloads.

Responsibilities

  • Design and implement kernel-level optimizations and inference pipeline improvements that reduce latency and increase throughput for LLM serving workloads.
  • Profile, benchmark, and tune model inference performance across hardware and software stacks, identifying bottlenecks and delivering measurable gains.
  • Write well-organized, maintainable code and participate actively in code reviews, providing constructive feedback to peers and mentoring newer engineers on the team.
  • Collaborate with applied scientists, ML engineers, and infrastructure teams to translate model requirements into production-ready inference solutions.
  • Evaluate emerging tools, frameworks, and generative AI techniques for inference optimization, recommending adoption where they improve efficiency or quality.

Qualifications

  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • 1+ years of software development engineer or related occupational experience
  • 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
  • 1+ years of Object Oriented Design experience
  • Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
  • Experience programming with at least one software programming language

Skills

Required:Kernel-level optimizationPerformance profiling and benchmarkingC/C++Code reviews and mentoringCollaboration with ML/infra teams

Benefits

  • Health insurance (medical, dental, vision, prescription)
  • Basic Life & AD&D insurance and option for Supplemental life plans
  • EAP, Mental Health Support
  • Flexible Spending Accounts
  • Adoption and Surrogacy Reimbursement coverage
  • 401(k) matching
  • Paid time off
  • Parental leave
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Amazon

Amazon.com, Inc. or its affiliates

liquid-ai-recruiting-target
Company profileWebsite

More open roles at Amazon