← All roles

Principal Software Development Engineer

AMD· Engineering
Apply on company site
San Jose, California$240k - $360kFull-timePosted 3d ago

About the role

Lead GPU performance optimization for large-scale AI training, reinforcement learning, and inference workloads on AMD GPU platforms, driving improvements across the software-hardware stack.

Responsibilities

  • Lead performance optimization of large-scale AI training/RL/inference workloads on AMD GPU platforms across single-node and multi-node environments.
  • Identify and eliminate system bottlenecks across compute, memory, and communication (e.g., kernel efficiency, memory bandwidth, network utilization).
  • Drive cross-stack optimizations spanning kernels, compilers, runtimes, communication libraries, and ML frameworks.
  • Develop and apply advanced profiling, benchmarking, and performance modeling methodologies.
  • Collaborate with hardware, compiler, and framework teams to influence next-generation GPU architecture and software stack design.
  • Contribute to and lead open-source efforts to improve ecosystem performance on AMD platforms.
  • Stay at the forefront of advancements in large-scale systems and performance optimization techniques.

Qualifications

  • Deep expertise in GPU architecture and performance characteristics (compute units, memory hierarchy, interconnects such as PCIe/Infinity Fabric/RDMA).
  • Strong experience with performance profiling tools (e.g., ROCm tools, Nsight-like systems, custom profilers) and bottleneck analysis.
  • Proven experience optimizing large-scale distributed training workloads across thousands of GPUs.
  • Experience with frameworks such as Megatron-LM, Torchtitan, vLLM, Sglang, or equivalent.
  • Strong understanding of communication libraries and patterns (e.g., NCCL/RCCL, collective ops, overlap of compute and communication).
  • Proficiency in Python and at least one systems language (C++/CUDA/HIP), including debugging and low-level optimization.
  • Experience with compiler stacks, kernel optimization, or graph-level optimization is a strong plus.
  • Demonstrated technical leadership and ability to influence cross-functional team
  • Masters or PhD or equivalent experience in Computer Science, Computer Engineering, or related field

Skills

Required:GPU performance engineeringCross-functional collaboration
Nice to have:GPU architecture and performance optimizationPerformance profiling and bottleneck analysisLarge-scale distributed trainingMachine learning frameworksCommunication libraries and patternsPython and systems programmingCompiler, kernel, or graph optimizationTechnical leadership

Benefits

  • Benefits offered are described: AMD benefits at a glance.
Last updated Nov 19, 2026. Interested? Apply on the company site.
AMD logo

About AMD

together we advance_AI

AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.

AIData CenterHigh-Performance ComputingGamingEdge Devices

More open roles at AMD