← All roles

Fellow Software Development Engineer, GEMM Optimization

AMD· Engineering
Apply on company site
Hybrid (San Jose, CA)$268kFull-timePosted 1mo ago

About the role

AMD is seeking a Fellow Software Development Engineer to architect and develop features in the tensile-lite assembly code generator for General Matrix Multiplication (GEMM) and GEMM + X (including attention), with a focus on hardware-aware optimization and delivering high-throughput matrix-multiply performance across AMD GPUs.

Responsibilities

  • Analyze AMD GPU hardware specifications in depth and work closely with hardware architects to align kernel design with current silicon capabilities and to influence requirements for future generations.
  • Develop support for new ISA and HW/SW optimization features in the code-generator
  • Innovate and implement new algorithms for implementing GEMM and GEMM + X
  • Profile and root-cause GEMM performance bottlenecks across the stack
  • Partner with customers and internal stakeholders to understand real-world workload requirements, reproduce performance issues, and deliver targeted performance

Qualifications

  • Strong command of GPU computer architecture: compute units, register files, cache/LDS hierarchies, memory bandwidth, matrix cores/WMMA-style instructions, and instruction scheduling/latency hiding.
  • Deep expertise in GEMM algorithms and their mapping onto GPU hardware (tiling, blocking, register/LDS allocation, wave scheduling, memory hierarchy utilization).
  • Strong software engineering fundamentals with a track record of building production-quality, high-performance software.
  • Demonstrated experience optimizing GPU compute kernels, ideally GEMM and attention
  • Proficiency in C++ and assembly-level GPU programming; working knowledge of Python for tooling/automation.
  • Solid understanding of parallel computing, memory hierarchies, and hardware-software performance tradeoffs.
  • Clear written and verbal communication skills; ability to work effectively with hardware architects, customers, and cross-functional engineering teams.
  • Direct experience with any GPU compiler backend
  • Experience with AMD GPU architectures (CDNA/RDNA) or comparable competitive architectures (NVIDIA Hopper/Blackwell, etc.)
  • Contributions to industry standards, publications, or patents related to GPU compute or matrix-multiply optimization

Skills

Required:GPU architecture knowledgeGEMM algorithmsC++Assembly-level GPU programming
Nice to have:Python

Benefits

  • Benefits offered are described: AMD benefits at a glance.
Last updated Oct 22, 2026. Interested? Apply on the company site.
AMD logo

About AMD

together we advance_AI

AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.

AIData CenterHigh-Performance ComputingGamingEdge Devices
Company profileWebsite

More open roles at AMD