← All roles

Software Development Engineer – AI/ML Networking Disaggregated Inference

Amazon· Annapurna Labs (U.S.) Inc. / Elastic Collectives
Apply on company site
Cupertino, CA$165.2k - $223.6kFull-timePosted 2w ago

About the role

Engineer to build high-speed data-mmovement components for disaggregated AI/ML inference, enabling KV cache and activations transfer across accelerators and memory over AWS high-performance networking fabric; focus on low-level, performance-critical systems bridging hardware, network, and inference frameworks.

Responsibilities

  • Build and optimize the low-level data-movement software that transfers KV cache and activations across accelerators, servers, and heterogeneous memory — over AWS's highest-performance network fabric.
  • Profile real workloads, identify bottlenecks, and push components toward hardware limits to improve performance.
  • Work across the stack—from network transport up to inference frameworks—to collaborate with chip, runtime, and model teams.
  • Deliver features deployed to large clusters for major customers, enabling production-scale AI models.

Qualifications

  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience programming with at least one software programming language (C/C++)
  • Experience with C/C++

Skills

Required:C/C++LinuxPerformance profiling
Nice to have:Networking / HPC interconnectsGPU/accelerator systemsSystem design and architecture

Benefits

  • Health insurance (medical, dental, vision, prescription) and Basic Life & AD&D, optional Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage
  • 401(k) matching
  • Paid time off and parental leave
  • Sign-on payments and RSUs included in total compensation
  • Comprehensive benefits information available on company site
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Amazon

Amazon.com, Inc. or its affiliates

liquid-ai-recruiting-target
Company profileWebsite

More open roles at Amazon