Lead HPC & AI Infrastructure Architect
San Jose, CA$210.4kFull-timePosted 1w ago
About the role
Lead the architecture and technical direction of large-scale CPU and GPU platforms across on-premises infrastructure, public cloud, and specialized GPU cloud providers to support tightly coupled HPC workloads, distributed model training, and AI inference services.
Responsibilities
- Lead the HPC and AI infrastructure roadmap, reference architectures, and standards for CPU/GPU clusters. Define workload placement across bare metal, virtual machines, Slurm, and Kubernetes.
- Lead designs covering CPU/NUMA and GPU topology, accelerator interconnects, networking, storage, and identity. Establish validated hardware, firmware, driver, and runtime baselines.
- Architect RDMA-capable fabrics and storage tiers. Validate collective communication, parallel I/O, dataset delivery, and checkpoint performance at target scale.
- Design resource sharing through Slurm accounting, fair-share, quotas, QoS, preemption, and tenant isolation. Enable reproducible environments, self-service onboarding, and inference capacity planning.
- Standardize provisioning, configuration, and fleet upgrades through infrastructure as code, automation, and CI/CD; manage images, containers, and configuration drift.
- Define production acceptance criteria, service-level objectives, and fleet observability. Partner with SRE teams on fault isolation, job recovery, checkpoint/restart, incident analysis, and capacity planning.
- Benchmark HPC and distributed AI workloads; improve scaling efficiency, throughput, inference latency, GPU utilization, reliability, and cost efficiency through bottleneck analysis.
- Incorporate federated identity, least-privilege access, tenant and network isolation, secrets management, controlled container privileges, audit logging, and vulnerability management into platform designs.
- Lead architecture reviews, proofs of concept, provider evaluations, and complex technical problem solving. Document decisions and tradeoffs, mentor engineers, and align delivery with stakeholders and infrastructure partners.
Qualifications
- Bachelor's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience.
Skills
Required:Infrastructure architectureLinux troubleshootingSlurm scheduling and resource governanceKubernetes or orchestrationMPI, distributed training, collective communication
Last updated Oct 22, 2026. Interested? Apply on the company site.
About AMD
together we advance_AI
AMD delivers leadership high-performance and adaptive computing solutions to advance data center AI, AI PCs, intelligent edge devices, gaming, & beyond.
AIData CenterHigh-Performance ComputingGamingEdge Devices
More open roles at AMD
- System Thermal Design Staff Engineer5d agoPenang, Malaysia · Engineering
- PD Engineer5d agoHybrid (Bangalore) · Engineering
- PD Engineer5d agoBangalore · Engineering
- Low-Power & CDC Verification Engineer5d agoSanta Clara, California · Engineering
- Technical Program Manager5d agoShanghai · Engineering