← All roles

Principal Software Engineer – PyTorch Training Frameworks

AMD· Engineering
Apply on company site
Hybrid (San Jose, CA)$240kFull-timePosted 6mo ago

About the role

Principal-level PyTorch training framework expert to drive performance, scalability, and correctness of large-scale AI training on AMD Instinct accelerators, collaborating across compiler, kernel, driver, and architecture teams and contributing to upstream PyTorch.

Responsibilities

  • Act as a technical authority for PyTorch training at AMD, setting direction for performance, scalability, and reliability
  • Drive optimization of key PyTorch training workloads (LLMs/foundation models) across single-node and multi-node systems
  • Improve and debug training performance in areas such as DDP/FSDP, gradient checkpointing, mixed precision, memory planning, and communication/computation overlap
  • Partner with ROCm compiler/runtime, kernel, and driver teams to resolve performance bottlenecks and correctness issues across the full stack
  • Contribute to and influence upstream PyTorch (design discussions, code contributions, performance fixes, CI/debug)
  • Develop and maintain representative training benchmarks, profiling workflows, and performance regression detection for key models
  • Lead deep-dive investigations of performance regressions and hard correctness issues; drive cross-team resolution to closure
  • Mentor engineers and raise the bar on framework-quality code, performance engineering practices, and technical rigor
  • Engage with strategic customers/partners on training enablement, root-cause analysis, and best-practices for AMD platforms

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent

Skills

Required:PyTorch internals and training systemsDistributed trainingPerformance engineeringProgramming
Nice to have:Ecosystem tooling

Benefits

  • Benefits offered are described: AMD benefits at a glance
Last updated Oct 22, 2026. Interested? Apply on the company site.
AMD logo

About AMD

together we advance_AI

AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.

AIData CenterHigh-Performance ComputingGamingEdge Devices
Company profileWebsite

More open roles at AMD