← All roles

Cloud Inference Engineer

Luminal· Engineering / Machine Learning
Apply on company site
San Francisco$150k - $250k + equityFull-timePosted 11mo ago

About the role

Luminal is hiring a Cloud Inference Engineer to deploy and optimize AI models for low-latency, high-throughput production serving on Luminal Cloud. Role is on-site in San Francisco and involves model deployment, optimization, performance reviews, and system-level improvements.

Responsibilities

  • Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.

Qualifications

  • CUDA + GPU inference optimization

Skills

Required:CUDATorch/PyTorch
Nice to have:SGLang / vLLM / TensorRT-LLMKV cachingDistributed compute with GPUsModel serving / scheduling / autoscaling
Last updated Aug 26, 2026. Interested? Apply on the company site.
Luminal logo

About Luminal

Making AI run fast on any hardware.

Luminal builds an ML framework and compiler that generates GPU code. Our stack 10x's model speed while simplifying deployment and cutting idle GPU costs Github: https://github.com/luminal-ai/luminal Discord: https://discord.gg/APjuwHAbGy

Company profileWebsite

More open roles at Luminal