← All roles

Member of Technical Staff — Inference-Core Engine

RadixArk· Member of Technical Staff
Apply on company site
Palo Alto, CA$200k - $400kFull-timePosted 5mo ago

About the role

Role focused on building and optimizing large-scale AI inference systems (frontier models) across GPUs, combining systems engineering, ML infrastructure, and performance optimization to reduce latency and increase throughput at scale.

Responsibilities

  • Design and build large-scale inference systems for frontier AI models
  • Optimize latency, throughput, and GPU utilization in production inference
  • Develop and improve model serving architectures and runtimes
  • Work on batching, scheduling, and memory management strategies
  • Collaborate with kernel, compiler, and systems teams on performance optimization
  • Debug performance bottlenecks across the stack
  • Drive reliability and scalability of inference infrastructure
  • Build tooling for observability, profiling, and performance analysis
  • Contribute to long-term inference architecture and strategy

Qualifications

  • 5+ years of experience in systems engineering, ML infrastructure, or performance-critical backend systems
  • Strong expertise in large-scale inference systems for LLMs or generative models
  • Deep understanding of GPU architecture and performance characteristics
  • Experience optimizing latency- and throughput-critical production systems
  • Strong knowledge of distributed systems and networking fundamentals
  • Proficiency in Python, Rust, C++, or Go for production systems
  • Experience profiling and optimizing compute-intensive workloads
  • Strong debugging skills across system layers (model, runtime, kernel, network)

Skills

Required:Experience with large-scale inference systems for LLMs or generative modelsGPU architecture and performance optimizationDistributed systems and networking fundamentalsProgramming in Python, Rust, C++, or GoProfiling and optimizing compute-intensive workloadsDebugging across system layers (model, runtime, kernel, network)
Last updated Aug 18, 2026. Interested? Apply on the company site.
RadixArk logo

About RadixArk

SHIP AI FOR ALL

RadixArk is an infrastructure-first, deep-tech company building large-scale inference and training systems for the entire AI community.

AI systemsMilesSGLangbessemer-ai-infrastructure-2026inferenceinference-inflection-pointinfrastructureopen infrastructure
Company profileWebsite

More open roles at RadixArk