Principal Software Development Engineer
San Jose, California$240k - $360kFull-timePosted 3d ago
About the role
Lead GPU performance optimization for large-scale AI training, reinforcement learning, and inference workloads on AMD GPU platforms, driving improvements across the software-hardware stack.
Responsibilities
- Lead performance optimization of large-scale AI training/RL/inference workloads on AMD GPU platforms across single-node and multi-node environments.
- Identify and eliminate system bottlenecks across compute, memory, and communication (e.g., kernel efficiency, memory bandwidth, network utilization).
- Drive cross-stack optimizations spanning kernels, compilers, runtimes, communication libraries, and ML frameworks.
- Develop and apply advanced profiling, benchmarking, and performance modeling methodologies.
- Collaborate with hardware, compiler, and framework teams to influence next-generation GPU architecture and software stack design.
- Contribute to and lead open-source efforts to improve ecosystem performance on AMD platforms.
- Stay at the forefront of advancements in large-scale systems and performance optimization techniques.
Qualifications
- Deep expertise in GPU architecture and performance characteristics (compute units, memory hierarchy, interconnects such as PCIe/Infinity Fabric/RDMA).
- Strong experience with performance profiling tools (e.g., ROCm tools, Nsight-like systems, custom profilers) and bottleneck analysis.
- Proven experience optimizing large-scale distributed training workloads across thousands of GPUs.
- Experience with frameworks such as Megatron-LM, Torchtitan, vLLM, Sglang, or equivalent.
- Strong understanding of communication libraries and patterns (e.g., NCCL/RCCL, collective ops, overlap of compute and communication).
- Proficiency in Python and at least one systems language (C++/CUDA/HIP), including debugging and low-level optimization.
- Experience with compiler stacks, kernel optimization, or graph-level optimization is a strong plus.
- Demonstrated technical leadership and ability to influence cross-functional team
- Masters or PhD or equivalent experience in Computer Science, Computer Engineering, or related field
Skills
Required:GPU performance engineeringCross-functional collaboration
Nice to have:GPU architecture and performance optimizationPerformance profiling and bottleneck analysisLarge-scale distributed trainingMachine learning frameworksCommunication libraries and patternsPython and systems programmingCompiler, kernel, or graph optimizationTechnical leadership
Benefits
- Benefits offered are described: AMD benefits at a glance.
Last updated Nov 19, 2026. Interested? Apply on the company site.
About AMD
together we advance_AI
AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.
AIData CenterHigh-Performance ComputingGamingEdge Devices
More open roles at AMD
- Firmware Engineer3d agoBangalore, India · Engineering
- DCGPU System Validation Lead3d agoPenang, Malaysia · Engineering
- Global Lease Administration Lead3d agoWashington, United States · General Management/ Administration/ Support
- Lead BIOS Firmware Engineer3d agoAustin, Texas · Engineering
- Memory PHY Architect3d agoBoxborough, MA, Other AMD locations · Engineering