← All roles

Senior Infrastructure Engineer

Vast AI· Engineering
Apply on company site
Los Angeles, San Francisco$200k - $330kFull-timePosted 3mo ago

About the role

Senior Infrastructure Engineer to design and scale Vast.ai’s core compute systems powering a global GPU marketplace, including provisioning, scheduling, billing, orchestration, and marketplace dynamics. On-site role in San Francisco or Westwood (Los Angeles).

Responsibilities

  • Improve the backend systems that power Vast.ai’s compute marketplace
  • Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs
  • Develop scalable infrastructure for workload scheduling and resource management
  • Optimize pricing and marketplace logic for efficiency and transparency
  • Benchmark, profile, and harden systems for performance, reliability, and fault tolerance
  • Collaborate with product and infrastructure teams to shape the future of decentralized compute

Qualifications

  • Distributed Systems: Experience building high-throughput backend systems or compute clouds
  • Compute Orchestration: Familiarity with Docker, or custom scheduling frameworks
  • GPU Infrastructure: Understanding of GPU provisioning, driver management, and workload scheduling
  • Billing & Metering: Implemented or integrated usage-based billing and account credit systems
  • Marketplace Dynamics: Knowledge of dynamic pricing, spot instances, or supply-demand balancing mechanisms
  • Security & Multi-Tenancy: Experience designing secure, multi-tenant systems in cloud environments
  • Programming: Strong programming skills in Python and C++; ability to write performant, maintainable, well-architected code
  • Database Expertise: Comfortable designing schemas and queries for large-scale data systems (PostgreSQL preferred)

Skills

Required:PythonC++

Benefits

  • Comprehensive health, dental, vision, and life insurance
  • 401(k) with company match
  • Meaningful early-stage equity
  • Onsite meals, snacks, and close collaboration with founders/tech leaders
  • Ambitious, fast-paced startup culture where initiative is rewarded
Last updated Sep 27, 2026. Interested? Apply on the company site.
Vast AI logo

About Vast AI

Rent GPUs | Vast.ai

Rent high-performance cloud GPUs at low cost with Vast.ai. Instantly deploy GPU rentals for AI, machine learning, deep learning, and rendering. Flexible pricing, fast setup, and global availability

AI AgentsAI Image + Video GenerationAI Text GenerationAI/ML FrameworksBatch Data ProcessingCase StudiesClustersGPU Cloud
Company profileWebsite

More open roles at Vast AI