Senior Compiler Software Development Engineer - AI/ML
San Jose, CA$240k - $360kFull-timePosted 2mo ago
About the role
Senior AI/ML compiler engineer role at AMD focusing on compiler optimizations and performance improvements for AI training and inference on AMD GPUs, contributing to ROCm, MLIR/LLVM stacks, and ONNX Runtime execution.
Responsibilities
- Work with AMD’s architecture specialists to improve future products
- Design, develop, and optimize compiler transformations and operator lowerings within MLIR, LLVM, and the ROCm software stack.
- Develop scalable solutions that improve portability and performance across AMD GPU architectures.
- Collaborate with compiler and runtime teams to develop advanced optimization strategies for AI workloads.
- Implement, validate, and maintain ONNX operators and microbenchmark test suites.
- Lead performance optimization efforts for AI training, fine-tuning, reinforcement learning (RL), and inference workloads on AMD GPUs.
- Design and implement graph-level, kernel-level, and runtime-level optimizations that deliver measurable performance gains.
- Analyze workload execution characteristics and identify opportunities for improvements in compute efficiency, memory utilization, and communication overhead.
- Drive performance characterization and benchmarking across pre-silicon and post-silicon environments.
Qualifications
- Strong proficiency in C++ and object-oriented software development.
- Hands-on experience with GPU programming technologies such as HIP, CUDA, Triton, or equivalent parallel programming frameworks.
- Experience with compiler technologies including MLIR, LLVM, or related compiler infrastructures.
- Strong understanding of machine learning frameworks, model execution pipelines, and AI workload optimization.
- Experience profiling and optimizing performance-critical software systems.
- Proficiency with Linux development environments, source control systems (Git), debugging tools, and performance profilers.
- Strong analytical, communication, and problem-solving skills.
Skills
Required:C++GPU programmingMLIR/LLVMAI workload optimizationPerformance profilingLinux / Git / debugging
Benefits
- Benefits offered are described: AMD benefits at a glance
Last updated Oct 15, 2026. Interested? Apply on the company site.
About AMD
together we advance_AI
AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.
AIData CenterHigh-Performance ComputingGamingEdge Devices
More open roles at AMD
- System Thermal Design Staff Engineer4d agoPenang, Malaysia · Engineering
- PD Engineer4d agoHybrid (Bangalore) · Engineering
- PD Engineer4d agoBangalore · Engineering
- Low-Power & CDC Verification Engineer4d agoSanta Clara, California · Engineering
- Technical Program Manager4d agoShanghai · Engineering