Member of Technical Staff, Kernels
Hybrid (San Francisco or Remote)$275k - $550kfull-timePosted 10mo ago
About the role
Kernel Engineer role to design, implement, and maintain high-performance kernels to optimize throughput and latency during training and inference, with a focus on long-context behavior and memory/data movement challenges.
Responsibilities
- Design and implement kernels that support high-performance long-context behavior
- Ownership of kernel design, implementation, deployment, and production reliability
- Focus on robustness, extensive testing, and functional correctness, while pushing on performance
- Evaluate porting Magic’s compute kernels to alternative hardware options
- Co-design kernels with understanding and interaction with training, inference, and RL teams
- Sample work reference: Magic-Attention, presented at GTC 2026
Qualifications
- Low-level programming experience targeting AI accelerators such as NVIDIA Blackwell or Google TPUs
- Develop and optimize GPU kernels in frameworks such as NCCL, MSCCLPP, CUTLASS, CuTeDSL, Triton, Quack, Flash-Attention, and similar frameworks
- Experience in other kernel authoring frameworks such as Pallas/Mosaic or Mojo
- Strong depth in computer architecture, low-level machine optimizations, and code generation with breadth across ML
- Agility, ownership mindset, and grit
Skills
Required:Low-level programmingGPU kernel developmentFramework experienceArchitecture and optimization
Benefits
- Annual salary ranges between $275K - $550K based on experience
- Equity is a significant part of total compensation, in addition to salary
- 401(k) plan with 6% salary matching
- Generous health, dental and vision insurance for you and your dependents
- Unlimited paid time off
- Visa sponsorship and relocation stipend to bring you to SF, if possible
- A small, fast-paced, highly focused team
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Magic
building safe AGI to accelerate humanity’s progress on the world’s most important problems.
Magic is an AI company that is working toward building safe AGI to accelerate humanity’s progress on the world’s most important problems.
AGIAI researchArtificial IntelligenceModelsResearchliquid-ai-recruiting-target
More open roles at Magic
- Member of Technical Staff, Pretraining Systems7mo agoHybrid (San Francisco) · Pretraining Systems
- Member of Technical Staff, Inference & RL Systems7mo agoHybrid (San Francisco, CA) · Inference & RL Systems
- Research Engineer10mo agoSan Francisco
- Member of Technical Staff, Security Engineer10mo agoSan Francisco, CA
- Member of Technical Staff, RL Research & Environments10mo agoHybrid (San Francisco, CA) · RL Research & Environments