← All roles

Member of Technical Staff — Backend/API Platform

RadixArk· Member of Technical Staff
Apply on company site
Palo Alto, CA$200k - $400kFull-timePosted 3mo ago

About the role

Backend/API Platform engineer building API layer, control plane, and platform services powering SGLang and Miles. Focus on REST/gRPC APIs, authentication, multi-tenancy, and observability to support production-grade AI infrastructure.

Responsibilities

  • Design and build production APIs for SGLang and Miles: REST/gRPC endpoints, client SDKs, API versioning
  • Implement authentication, authorization, and rate limiting systems for multi-tenant deployments
  • Build control plane infrastructure: job scheduling, resource allocation, model deployment management
  • Create monitoring, logging, and observability systems for production inference and training workloads
  • Design and implement billing integration, usage tracking, and quota management
  • Build management dashboards and admin tools for cluster operations
  • Ensure API reliability, performance, and security at scale
  • Implement multi-tenancy isolation and security boundaries
  • Create deployment automation, CI/CD pipelines, and rollback procedures
  • Write comprehensive API documentation and integration guides
  • Partner with Systems Engineers to optimize end-to-end latency from API → serving layer
  • Debug production issues and implement reliability improvements

Qualifications

  • 4+ years experience building production backend systems, APIs, or platform infrastructure
  • Bachelor's or Master's degree in Computer Science, Engineering, or equivalent industry experience
  • Strong proficiency in Python, Go, or Rust with production-quality code standards
  • Experience designing and building REST/gRPC APIs at scale
  • Solid understanding of distributed systems, databases, caching, and message queues
  • Experience with authentication, authorization, rate limiting, and multi-tenancy
  • Familiarity with cloud platforms (AWS, GCP, Azure) and Kubernetes
  • Experience with monitoring and observability tools (Prometheus, Grafana, DataDog)
  • Understanding of ML serving infrastructure or high-throughput systems is a plus

Skills

Required:API design and developmentAuthentication and authorizationDistributed systemsCloud and KubernetesMonitoring and observabilityCI/CD
Last updated Sep 22, 2026. Interested? Apply on the company site.
RadixArk logo

About RadixArk

SHIP AI FOR ALL

RadixArk is an infrastructure-first, deep-tech company building large-scale inference and training systems for the entire AI community.

AI systemsMilesSGLangbessemer-ai-infrastructure-2026inferenceinference-inflection-pointinfrastructureopen infrastructure
Company profileWebsite

More open roles at RadixArk