← All roles

Software Engineer, Distributed Systems

fal.ai· Engineering
Apply on company site
Remote - Global$180k - $250kFull-timePosted 3mo ago

About the role

Experienced software engineer dedicated to building large-scale, reliable computing platforms for AI inference and GPU-heavy workloads. Focused on delivering reliability, performance, and scale with minimal operational load.

Responsibilities

  • Take ownership of one or more Rust/Python systems powering AI inference and large-scale GPU computing platform
  • Design for 100x growth in workloads and GPU capacity with reliable, low-latency execution globally
  • Use AI to accelerate development, automate repetitive operations, alerting, and recovery
  • Specialize in one or more areas: request routing and queuing at global scale, app deployment and autoscaling, worker orchestration and placement, GPU fleet autoscaling and capacity management, GPU fleet lifecycle automation (provisioning, diagnostics & recovery, upgrades, tracking), global file storage, caching and distribution, global IP backbone (private networking across datacenters, elastic public IPs, ACLs/firewalls, private connectivity), workload execution (containerization, globally distributed filesystems, RAM/VRAM snapshotting)

Qualifications

  • 3+ years building and operating large-scale production systems with reliability and scale
  • Strong Rust and/or Python skills
  • Strong systems fundamentals relevant to specialization: distributed coordination, scheduling, fault tolerance, Linux, networking, storage, or capacity management
  • Experience using observability to drive performance and reliability decisions
  • Clear communication, sound technical judgment, initiative to move quickly and own systems from design through production
  • Multi-tenant compute platforms, AI inference or training infrastructure, GPU workload scheduling
  • High-performance systems programming: async runtimes, zero-copy, memory-safe concurrency
  • Linux systems engineering and fleet automation: configuration management, kernel and driver debugging, safe upgrades, automated recovery
  • Distributed filesystems like JuiceFS and Lustre
  • Experience with Nvidia/AMD GPU infrastructure; DCGM, NVLink, RDMA, InfiniBand/RoCEv2
  • Global networking and routing: BGP, ECMP, tunnels, eBPF, Geneve

Skills

Required:RustPython

Benefits

  • Interesting and challenging work
  • A lot of learning and growth opportunities
  • Regular team events and offsites
  • U.S. Equal Employment Opportunity information provided by fal (non-discriminatory policy)
Last updated Oct 24, 2026. Interested? Apply on the company site.

About fal.ai

ai-infrastructure-and-developmentwing-list-2026wing-list-2026-late-stage
Company profileWebsite

More open roles at fal.ai