← All roles

Member of Technical Staff - GPU Infrastructure

Prime Intellect· Engineering
Apply on company site
Remote$150k - $300kFull-timePosted 11mo ago

About the role

Prime Intellect is building the open superintelligence stack and a full-stack platform for post-training at frontier scale, enabling teams to run large-scale GPU workloads, training, inference, and deployment with open frontier AI and tools for continuous improvement.

Responsibilities

  • Partner with clients to understand workload requirements and design optimal GPU cluster architectures
  • Create technical proposals and capacity planning for clusters ranging from 100 to 10,000+ GPUs
  • Develop deployment strategies for LLM training, inference, and HPC workloads
  • Present architectural recommendations to technical and executive stakeholders
  • Deploy and configure orchestration systems including SLURM and Kubernetes for distributed workloads
  • Implement high-performance networking with InfiniBand, RoCE, and NVLink interconnects
  • Optimize GPU utilization, memory management, and inter-node communication
  • Configure parallel filesystems (Lustre, BeeGFS, GPFS) for optimal I/O performance
  • Tune system performance from kernel parameters to CUDA configurations
  • Serve as primary technical escalation point for customer infrastructure issues
  • Diagnose and resolve complex problems across the full stack - hardware, drivers, networking, and software
  • Implement monitoring, alerting, and automated remediation systems
  • Provide 24/7 on-call support for critical customer deployments
  • Create runbooks and documentation for customer operations teams

Qualifications

  • 3+ years hands-on experience with GPU clusters and HPC environments
  • Deep expertise with SLURM and Kubernetes in production GPU settings
  • Proven experience with InfiniBand configuration and troubleshooting
  • Strong understanding of NVIDIA GPU architecture, CUDA ecosystem, and driver stack
  • Experience with infrastructure automation tools (Ansible, Terraform)
  • Proficiency in Python, Bash, and systems programming
  • Track record of customer-facing technical leadership
  • NVIDIA driver installation and troubleshooting (CUDA, Fabric Manager, DCGM)
  • Container runtime configuration for GPUs (Docker, Containerd, Enroot)
  • Linux kernel tuning and performance optimization
  • Network topology design for AI workloads
  • Power and cooling requirements for high-density GPU deployments

Skills

Required:GPU clusters / HPCSLURMKubernetesInfiniBand / RoCE / NVLinkNVIDIA CUDA / driver stackAnsible / TerraformPython / BashCustomer-facing technical leadershipLinux performance tuning
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Prime Intellect

Commoditizing Compute & Intelligence

Prime Intellect democratizes AI development at scale. Our platform makes it easy to find global compute resources and train state-of-the-art models through distributed training across clusters. Collectively own the resulting open AI innovations, from language models to scientific breakthroughs.

AI developmentbessemer-ai-infrastructure-2026compute resourcesdistributed trainingmodelsreinforcement-learning-platformsscience
Company profileWebsite

More open roles at Prime Intellect