← All roles

Principal AI Software Engineer

AMD· Engineering
Apply on company site
Hybrid (San Jose, CA)$240kFull-timePosted 6mo ago

About the role

AMD AI Group seeks a senior technical leader to drive the OneROCm ROCm software stack across AMD’s product portfolio, coordinating hardware/software co-design and influencing the full AI software stack from compilers to performance optimization.

Responsibilities

  • Hardware-Software Co-design: Collaborate across hardware architecture, compiler, math libraries, kernel and framework teams to influence future silicon features based on evolving AI workload trends.
  • Strong Execution: Deliver innovations and roadmap for AI software stack across all AMD products, ensuring AMD remains the platform of choice for top-tier AI customers.
  • Workload Performance Engineering: Lead the profiling, analysis, and tuning of large-scale models (LLMs, Diffusion, Multimodal, and MoE) to ensure "out-of-the-box" performance excellence on AMD hardware.
  • Ecosystem Innovation: Drive the development of advanced tools and frameworks for performance estimation, modeling, and automated reporting.
  • Customer Engagement: Partner with top customers and hyperscalers to understand their unique workload requirements and deliver tailored architectural wins and software optimizations.
  • Community & Open Source: Mentor and inspire other engineers and contribute to ROCm Opensource.

Qualifications

  • Knowledge in GPU architectures, basic knowledge of CPU architecture
  • Experience in AI/ML software stack spanning compilers, kernels, runtime, libraries, models, frameworks, and performance optimization layers
  • Understanding of GPU programming such as ROCm, CUDA, OpenCL, etc
  • Experience in hardware/software co-design, building high-performance products across the full product lifecycle
  • Experience with operating systems (OS) and device driver development is a plus
  • Undergrad degree required. Bachelor of Science; Masters or PhD in Electrical Engineering, Computer Architecture, or Computer Science with relevant experience preferred

Skills

Required:GPU architecturesAI/ML software stackGPU programmingHardware/software co-design
Nice to have:CPU architectureOS and device drivers
Last updated Oct 22, 2026. Interested? Apply on the company site.
AMD logo

About AMD

together we advance_AI

AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.

AIData CenterHigh-Performance ComputingGamingEdge Devices
Company profileWebsite

More open roles at AMD