← All roles

AI, HPC & GPU Infrastructure Support Engineer

Vast AI· Operations
Apply on company site
Los Angeles$90k - $150kFull-timePosted 2mo ago

About the role

Role focused on troubleshooting Linux and GPU infrastructure issues (NVIDIA drivers, CUDA, GPU workloads, Ubuntu, Docker, KVM, networking, hardware, BIOS/firmware) and providing end-to-end escalation support, diagnosis, tooling, and runbooks to minimize incidents. Collaborative role with engineering and host support teams, emphasizing strong GPU troubleshooting, Linux expertise, and customer-facing technical support.

Responsibilities

  • Diagnose and resolve issues across NVIDIA CUDA/GPU drivers, Docker, and KVM virtualization environments
  • Investigate GPU utilization, container resource constraints, thermal throttling, driver conflicts, and disk I/O bottlenecks
  • Assist clients and infrastructure suppliers with TensorFlow, PyTorch, and other GPU-accelerated workloads
  • Troubleshoot network-layer issues (VLAN, DNS, DHCP, VPN, NAT, firewall, connectivity) on host machines
  • Handle escalated support tickets involving GPU workload failures, container issues, networking problems, account infrastructure, and host-side configuration
  • Provide managed support for supplier onboarding and ongoing machine management (installation, configuration, post-setup troubleshooting)
  • Advise suppliers on hardware setup, driver configuration, BIOS/firmware settings, and network configuration for optimal performance
  • Provide coverage for L1 support overflow during peak periods or incidents
  • Write and maintain internal runbooks, escalation guides, and knowledge base articles
  • Build diagnostic and automation tooling in Python and Bash to reduce manual triage
  • Collaborate with engineering and support teams to document systemic or recurring platform issues

Qualifications

  • Strong Linux systems operations experience with Ubuntu, RHEL/CentOS, or Debian (networking, storage, services, permissions)
  • Proficiency with Docker (debugging, Compose, image management, cgroup limits, storage, filesystem troubleshooting)
  • Experience with virtualization platforms (Proxmox VE, VMware, or similar) including VM provisioning and troubleshooting
  • Strong networking fundamentals (VLANs, DNS, DHCP, NAT, VPNs, firewall rules, L2/L3)
  • Hands-on experience with NVIDIA GPU drivers, CUDA, and GPU workload troubleshooting
  • Python and Bash scripting for automation and diagnostic tooling
  • Strong written English communication, clear, professional, and technically precise
  • Experience providing technical support in customer-facing or internal help desk environments
  • Ability to prioritize across a concurrent queue of escalated tickets, triage by severity and impact, balance reactive resolution with proactive documentation and tooling, and decide when to escalate vs own resolution

Skills

Required:Linux systems administrationDockerVirtualizationNetworkingNVIDIA GPU drivers & CUDAPython & Bash scripting

Benefits

  • Comprehensive health, dental, vision, and life insurance
  • 401(k) with company match
  • Meaningful early-stage equity
  • Onsite meals, snacks, and close collaboration with founders/tech leaders
  • Ambitious, fast-paced startup culture where initiative is rewarded
Last updated Aug 16, 2026. Interested? Apply on the company site.
Vast AI logo

About Vast AI

Rent GPUs | Vast.ai

Rent high-performance cloud GPUs at low cost with Vast.ai. Instantly deploy GPU rentals for AI, machine learning, deep learning, and rendering. Flexible pricing, fast setup, and global availability

AI AgentsAI Image + Video GenerationAI Text GenerationAI/ML FrameworksBatch Data ProcessingCase StudiesClustersGPU Cloud
Company profileWebsite

More open roles at Vast AI