Member of Technical Staff - Compiler Engineer
San Francisco, CA$180k - $400kFull-timePosted 3mo ago
About the role
Compiler-focused role building Gimlet's AI Compiler Stack for heterogeneous hardware, contributing to architecture, optimization, and execution planning across multi-silicon AI inference systems.
Responsibilities
- Scaling the compiler architecture to heterogeneous compute architectures across CPUs, GPUs, and accelerators with different memory models and toolchains.
- Optimizing end-to-end performance including operator fusion, middle-end optimizations, target-specific optimizations, and execution-planning decisions for partitioning computation and data movement across devices.
- Evaluating and integrating AI-generated kernels (CUDA, Metal) as a first-class code-generation strategy and deciding when generated kernels outperform libraries or hand-written ones.
- Supporting new models and serving techniques in production with efficient cross-target performance and minimal per-target tuning.
- Designing execution strategies for partitioning workloads across heterogeneous hardware.
Qualifications
- Experience building ML compilers and runtimes with a focus on performance optimizations.
- Experience with MLIR, LLVM, or comparable compiler infrastructure.
- Experience designing intermediate representations, writing compiler passes, or implementing lowering and code-generation pipelines.
- Strong C++ and/or Python skills.
- Solid understanding of SSA, memory systems, scheduling, and hardware efficiency.
- Experience with operator fusion, tiling, layout transformations, or memory planning.
- Experience using profilers to investigate performance across software and hardware boundaries.
- Experience with IREE, XLA, TVM, Triton, or similar ML compilers and tooling.
Skills
Required:MLIR/LLVM-based compiler developmentIntermediate representations and compiler passesC++Memory systems and hardware efficiency
Nice to have:PythonOperator fusion and tiling
Last updated Oct 11, 2026. Interested? Apply on the company site.
About Gimlet Labs
Gimlet Labs
Gimlet Labs is an applied research lab focused on building high performance AI systems.
Autonomous kernel generation for heterogeneous hardwareCost-aware optimization frameworks for AI workloadsGimlet cloudHeadless hardware architectures for serving AI inferenceHybrid edge/cloud workload partitioning and orchestrationSLA-aware dynamic datacenter scheduling of AI agent workloadsUniversal AI compiler for heterogeneous hardwarebessemer-ai-infrastructure-2026
More open roles at Gimlet Labs
- FP&A Manager, Infrastructure & CorporatetodaySan Francisco, CA · G&A
- Materials and Product Lifecycle Program ManagertodaySan Francisco, CA · Research and Development
- Project Coordinator, Hardware Partnerships1w agoSan Francisco, CA · Sales and Marketing
- Data Center Architect1w agoSan Francisco, CA · Technology and Infrastructure
- Strategic Hardware Partnerships1w agoSan Francisco, CA · Sales and Marketing