← All roles

AI/ML Compiler Developer (NPU Acceleration)

AMD· Engineering
Apply on company site
HyderabadFull-timePosted 1mo ago

About the role

Lead/Staff Software Engineer role within AMD's AI group focused on developing AI/ML C/C++ kernels and dataflow schedules for NPU acceleration on XDNA NPUs for mapping LLMs and diffusion networks, with emphasis on vector processor optimization and performance tuning.

Responsibilities

  • Kernel Development: Design and implement highly optimized C++ kernel library for NPU/GPU.
  • Collaborate with research and software teams to integrate kernels into the existing software stack.
  • Vector Processor Optimization: Work with hardware engineers to understand VLIW vector core architectures (MAC, GeMM, nonlinear functions); develop vectorized code leveraging SIMD and ILP.
  • Performance Profiling and Tuning: Profile, analyze, identify bottlenecks, and optimize critical sections for throughput.
  • Testing and Validation: Develop CPU models for ML operators in C++/Python to validate accuracy; write unit and integration tests; validate kernel performance across platforms.
  • Documentation and Collaboration: Document design specs, follow coding guidelines, use git for version control, create PRs and documentation; collaborate with ML researchers and software engineers.

Qualifications

  • Excellent C/C++ and Python coding skills
  • Good understanding of SIMD/Tensor/VLIW processor architecture to exploit parallelism
  • Experience with vectorized programming (SIMD) and parallel computing
  • Familiarity with ML frameworks (TensorFlow, PyTorch) a plus
  • Experience with silicon bring-up and pre-silicon validation on emulation platforms a plus
  • Knowledge of low-level hardware details (cache hierarchy, memory access patterns) desirable
  • Excellent problem-solving skills and passion for performance optimization

Skills

Required:C/C++ programmingPythonVectorized programming (SIMD)Parallel computing
Nice to have:ML frameworks familiarity

Benefits

  • AMD benefits at a glance
Last updated Oct 22, 2026. Interested? Apply on the company site.
AMD logo

About AMD

together we advance_AI

AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.

AIData CenterHigh-Performance ComputingGamingEdge Devices
Company profileWebsite

More open roles at AMD