GPU Cluster Architect
Hybrid (India), Hybrid (Singapore)Posted 2mo ago
About the role
GPU Cluster Architect at Nebius to design and scale next-generation AI infrastructure, spanning compute, networking, and storage across multiple data center sites with a hands-on, high-impact architectural focus.
Responsibilities
- Cluster Design: Architect scalable GPU cluster topologies including compute nodes, interconnect (InfiniBand, Ethernet), storage, and control planes.
- Performance Modeling: Analyze AI/ML workloads (e.g. LLM training, inference) to inform design tradeoffs across latency, bandwidth, and GPU density.
- Network Architecture: Align with network architect relevant design and validate low-latency, high-throughput interconnects (e.g., InfiniBand HDR/NDR, RoCEv2) at POD and DC scale.
- Storage Integration: Work with storage teams to optimize performance for training datasets, checkpointing, and others.
- Reliability & Monitoring: Understand and analyze signal from monitoring systems to the detect flows in design
- Collaboration: Partner with site reliability, networking, storage, and DC engineering teams to operationalize and scale your architecture.
Qualifications
- 5+ years of experience designing clusters.
- Deep understanding of modern GPU architecture (NVIDIA, AMD, etc.).
- Experience with HPC interconnects (InfiniBand & RoCE).
- Solid background in systems architecture, networking, and hardware reliability.
- Experience in scripting for automation and telemetry pipelines (Python, Go, etc.)
Skills
Required:Cluster designGPU architectureHPC interconnectsSystems architectureScripting for automation
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Last updated Aug 5, 2026. Interested? Apply on the company site.
About Nebius
The ultimate cloud for AI explorers
Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.
AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
More open roles at Nebius
- Staff Machine Learning Engineer, LLM Inference Optimization4d agoHybrid (Remote/Hybrid across listed locations) · ML
- Staff Site Reliability engineer - Network infrastructure - APAC4d agoRemote · Network Infrastructure
- Engineering manager - Network infrastructure - APAC4d agoRemote · Network Infrastructure
- Staff Software engineer - Network infrastructure - APAC4d agoRemote · Network Infrastructure
- Transportation Logistics Specialist4d agoHybrid (Europe) · Infrastructure