← All roles

Software Engineer - GPU Kernels

Baseten· EPD
Apply on company site
Hybrid (San Francisco), Hybrid (Toronto), Hybrid (New York), Hybrid (Montreal), Hybrid (Seattle)$180k - $360kFull-timePosted 11mo ago

About the role

GPU Kernel Engineer focused on high-performance GPU kernels for ML operations, with opportunities to contribute to internal/open-source libraries and present at industry conferences. Hybrid work in multiple cities with strong emphasis on low-level optimization and production-ready acceleration for AI workloads.

Responsibilities

  • Design and implement high-performance GPU kernels for key ML operations, including matrix multiplications, attention mechanisms, and mixture-of-experts routing
  • Write and optimize code using CUDA, PTX assembly, and architecture-specific techniques
  • Apply advanced performance optimization methods such as memory coalescing, warp-level programming, tensor core acceleration, and compute/memory overlap
  • Implement cutting-edge features like quantization (FP8/FP4), sparsity, and compute/communication overlap
  • Identify and resolve performance bottlenecks using tools like Nsight Systems, Nsight Compute, and Torch Profiler
  • Collaborate with research teams to productionize theoretical advancements
  • Contribute to internal and open-source GPU libraries
  • Present technical contributions at industry conferences (e.g., NVIDIA GTC, AWS re:Invent)

Qualifications

  • Strong understanding of GPU architecture and programming paradigms: memory hierarchy (global, shared, registers, L1/L2 cache), thread/block/grid organization, synchronization techniques and race condition mitigation
  • Proficient in C++ and GPU performance profiling tools
  • Knowledge of CUDA C++ API, memory access patterns and bandwidth optimization, numerical precision and quantization strategies, modern GPU features (e.g., tensor cores, async operations)

Skills

Required:GPU kernel developmentPerformance profilingC++CUDA/CUDA C++
Nice to have:Quantization/mixed precisionTransformer/attention optimizationGEMM tuningOpen-source contributions

Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (office closed from Christmas Eve to New Year’s Day)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering learning and networking opportunities
Last updated Oct 21, 2026. Interested? Apply on the company site.
Baseten logo

About Baseten

Inference is everything

Effortlessly serve optimized open source & custom models on the fastest, most reliable model delivery network.

AICloud InfrastructureDeveloper ToolsInference PlatformMachine LearningModel DeploymentModel Runtimesai-infrastructure-and-development
Company profileWebsite

More open roles at Baseten