Member of Technical Staff, Inference & RL Systems
Hybrid (San Francisco, CA)$275k - $550kFull-timePosted 7mo ago
About the role
Research Engineer role focusing on design and operation of distributed systems that serve models in production and power large-scale post-training workflows, balancing inference latency, throughput, stability, and reliability for long-context, KV-cache-intensive workloads.
Responsibilities
- Design and scale high-performance inference serving systems
- Optimize KV-cache management, batching strategies, and scheduling
- Improve throughput and latency for long-context workloads
- Build and maintain distributed RL and post-training infrastructure
- Improve reliability of rollout, evaluation, and reward pipelines
- Automate fault detection and recovery for serving and RL systems
- Profile and eliminate performance bottlenecks across GPU, networking, and storage layers
- Collaborate with Kernels and Research to align execution systems with model architecture
Qualifications
- Strong software engineering and distributed systems fundamentals
- Experience building or operating large-scale inference or training systems
- Deep understanding of GPU execution constraints and memory trade-offs
- Experience debugging performance issues in production ML systems
- Ability to reason about system-level trade-offs between latency, throughput, and cost
- Track record of owning critical production infrastructure
Skills
Required:Software engineering fundamentalsDistributed systemsLarge-scale inference/training systemsGPU memory constraints
Benefits
- Annual salary range: $275K - $550K
- Equity is a significant part of total compensation, in addition to salary
- 401(k) plan with 6% salary matching
- Generous health, dental and vision insurance for you and your dependents
- Unlimited paid time off
- Visa sponsorship and relocation stipend to bring you to SF, if possible
- A small, fast-paced, highly focused team
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Magic
building safe AGI to accelerate humanity’s progress on the world’s most important problems.
Magic is an AI company that is working toward building safe AGI to accelerate humanity’s progress on the world’s most important problems.
AGIAI researchArtificial IntelligenceModelsResearchliquid-ai-recruiting-target
More open roles at Magic
- Member of Technical Staff, Pretraining Systems7mo agoHybrid (San Francisco) · Pretraining Systems
- Research Engineer10mo agoSan Francisco
- Member of Technical Staff, Security Engineer10mo agoSan Francisco, CA
- Member of Technical Staff, RL Research & Environments10mo agoHybrid (San Francisco, CA) · RL Research & Environments
- <insert-job-you-excel-at/>10mo agoSan Francisco