AI Software Engineer
ShanghaiFull-timePosted 2mo ago
About the role
Role focused on optimizing and developing deep learning frameworks for AMD GPUs, with responsibilities spanning end-to-end optimization, collaboration with GPU library teams and open-source maintainers, and work in distributed computing environments to improve training and inference performance on AMD GPUs.
Responsibilities
- End to end optimization: Build and optimize end to end distributed inference (e.g, P/D disaggregation and Large-EP) and RL solutions on mainstream frameworks like vLLM and SGlang.
- Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs.
- Collaborate with Open-Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream.
- Work in Distributed Computing Environments: Optimize deep learning performance on both scale-up (multi-GPU) and scale-out (multi-node) systems.
- Utilize Cutting-Edge Compiler Tech: Leverage advanced compiler technologies to improve deep learning performance.
- Optimize Deep Learning Pipeline: Enhance the full pipeline, including integrating graph compilers.
- Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions.
Qualifications
- Master’s or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related fields.
- 5+ years of professional experience in technical software development, with a focus on GPU optimization, performance engineering, and framework development.
Skills
Required:C++ development
Nice to have:Python
Benefits
- Benefits offered are described: AMD benefits at a glance.
Last updated Oct 22, 2026. Interested? Apply on the company site.
About AMD
together we advance_AI
AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.
AIData CenterHigh-Performance ComputingGamingEdge Devices
More open roles at AMD
- System Thermal Design Staff Engineer4d agoPenang, Malaysia · Engineering
- PD Engineer4d agoHybrid (Bangalore) · Engineering
- PD Engineer4d agoBangalore · Engineering
- Low-Power & CDC Verification Engineer4d agoSanta Clara, California · Engineering
- Technical Program Manager4d agoShanghai · Engineering