GPU Cluster Architect
Hybrid (USA)$184k - $318k + equityfull-timePosted 7mo ago
About the role
GPU Cluster Architect role at Nebius, focused on end-to-end architectural decisions for next-generation AI infrastructure, covering compute, networking, and storage across large-scale GPU clusters and multiple data center sites. Remote work from the USA.
Responsibilities
- Cluster Design: Architect scalable GPU cluster topologies including compute nodes, interconnect (InfiniBand, Ethernet), storage, and control planes.
- Performance Modeling: Analyze AI/ML workloads (e.g. LLM training, inference) to inform design tradeoffs across latency, bandwidth, and GPU density.
- Network Architecture: Align with network architect relevant design and validate low-latency, high-throughput interconnects (e.g., InfiniBand HDR/NDR, RoCEv2) at POD and DC scale.
- Storage Integration: Work with storage teams to optimize performance for training datasets, checkpointing, and others.
- Reliability & Monitoring: Understand and analyze signal from monitoring systems to the detect flows in design.
- Collaboration: Partner with site reliability, networking, storage, and DC engineering teams to operationalize and scale your architecture.
Qualifications
- 5+ years of experience designing clusters.
- Deep understanding of modern GPU architecture (NVIDIA, AMD, etc.).
- Experience with HPC interconnects (InfiniBand & RoCE).
- Solid background in systems architecture, networking, and hardware reliability.
- Experience in scripting for automation and telemetry pipelines (Python, Go, etc.)
Skills
Required:GPU cluster designPerformance modelingNetwork architecture and interconnects
Benefits
- Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families.
- 401(k) plan: Up to 4% company match with immediate vesting.
- Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
- Remote work reimbursement: Up to $85/month for mobile and internet.
- Disability & life insurance: Company-paid short-term, long-term and life insurance coverage.
Last updated Oct 7, 2026. Interested? Apply on the company site.
About Nebius
The ultimate cloud for AI explorers
Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.
AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
More open roles at Nebius
- Staff Machine Learning Engineer, LLM Inference Optimization5d agoHybrid (Remote/Hybrid across listed locations) · ML
- Staff Site Reliability engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Engineering manager - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Staff Software engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Transportation Logistics Specialist5d agoHybrid (Europe) · Infrastructure