← All roles

HPC Infrastructure Engineer - GPU Clusters

ElevenLabs· Research & Research Engineering
Apply on company site
RemoteFull-timePosted 1mo ago

About the role

Engineer responsible for owning and operating ElevenLabs' NVIDIA GPU clusters (bare metal and rented capacity) to maximize training throughput and researcher velocity. A builder-operator role with broad scope and autonomy focusing on automation, performance, reliability, and end-to-end stack for GPU infrastructure.

Responsibilities

  • Operate and improve our GPU fleet end to end: provisioning, scheduling, monitoring, upgrades, capacity planning
  • Build automation that keeps the fleet healthy without human intervention — node health checks, automated draining and remediation, burn-in pipelines for new capacity
  • Own the stack beneath the training code: OS images, NVIDIA drivers, CUDA, container runtimes, NCCL, high-speed networking (InfiniBand/RoCE)
  • Run and tune job scheduling (Slurm or similar) so researchers get compute fairly and fast
  • Build and maintain high-performance storage for datasets and checkpoints
  • Hunt down performance problems: stragglers, degraded links, thermal issues, flaky GPUs — and fix the class of problem, not just the instance
  • Evaluate rented GPU capacity: benchmark it, validate it, hold providers to their SLAs
  • Hands-on hardware work when it's needed: racking, cabling, diagnostics, coordinating with datacenter staff and vendors
  • Keep clusters secure by default: access control, network isolation, secrets

Qualifications

  • Have run large-scale Linux server or GPU environments in production and enjoy both building and operating
  • Know the NVIDIA stack well — drivers, CUDA, NCCL, DCGM — or have deep systems experience and learn hardware stacks fast
  • Are comfortable with bare-metal environments, server hardware, and high-speed networking
  • Write solid automation in Python and/or Bash, with IaC tools like Ansible or Terraform
  • Are happy digging into noisy data (metrics, logs, PromQL) to find what's actually wrong
  • Like owning real scope end to end and being the person others rely on
  • Don't consider any task above or beneath you — datacenter trips included

Skills

Required:Linux server / GPU environments (production)NVIDIA stack (drivers, CUDA, NCCL, DCGM)Bare-metal / high-speed networkingAutomation / IaC (Python, Bash, Ansible, Terraform)Observability / data analysis (metrics, logs, PromQL)End-to-end ownership

Benefits

  • Learning & development: annual discretionary stipend
  • Social travel: annual discretionary stipend
  • Annual company offsite
  • Co-working stipend
  • Innovative culture and growth opportunities
Last updated Oct 22, 2026. Interested? Apply on the company site.
ElevenLabs logo

About ElevenLabs

Free AI Voice Generator & Voice Agents Platform | ElevenLabs

Create lifelike speech with our AI voice generator and voice agents platform. Access 5,000+ voices in 70+ languages with secure APIs and SDKs.

AI Voice AgentsAPIAPI ReferenceAboutAffiliatesAgents PlatformAudio NativeBlog
Company profileWebsite

More open roles at ElevenLabs