Distributed Systems Engineer
San FranciscoFull-timePosted 3d ago
About the role
Relace is building a globally distributed inference cloud. The role focuses on the routing layer, capacity planning across multi-cloud fleets, and how the distributed inference fleet scales and operates under load using Rust services and Kubernetes.
Responsibilities
- Work on how the globally distributed inference runs: the routing layer deciding which machine handles a request, what happens when more work arrives than we have capacity for, and how the fleet grows and shrinks across clouds as demand moves.
- Contribute to Rust services and Kubernetes services that manage a multi-cloud fleet
- Own whole systems and be responsible for production behavior, including latency and failure handling
- Debug production issues and articulate detailed root-cause analyses of failures
- Enhance systems reliability and performance in a multi-cloud, distributed environment
Qualifications
- Around five or more years building real production systems where latency and failure behaviour mattered (serving systems, control planes, schedulers, databases, networking, trading systems)
- A systems language you know well (Rust, C++ or Go)
- Real ownership of something that ran under load and ability to discuss a production failure debugged in detail
- Kubernetes at the level of someone who has extended it, particularly on low-reliability infrastructure
Skills
Required:Production systems ownershipSystems programming languageKubernetes
Benefits
- Competitive compensation
- Equity
- In-person work in San Francisco, five days a week
- Opportunity to work on high-impact, fast-growing distributed systems in a GPU-based inference cloud
Last updated Oct 22, 2026. Interested? Apply on the company site.
About Relace
Models and infra for coding agents
Relace makes it easy to deploy production-ready coding agents. Our models are co-optimized with infrastructure to achieve SoTA performance: 10k+ token/s code merging and retrieval across million-line repositories in seconds.
More open roles at Relace
- GPU Kernel Engineer3d agoSan Francisco · Kernels
- GTM Engineer11mo agoHybrid (San Francisco, CA)
- Machine Learning Scientist11mo agoHybrid (San Francisco, CA)