Senior On-Device AI Inference Performance Engineer
San Mateo, CAFull-timePosted 3mo ago
About the role
Senior-level role focusing on C/C++ performance optimization and low-level systems to power on-device AI inference workloads and end-to-end optimization of the inference stack for diverse hardware.
Responsibilities
- Innovate on the inference optimization pipeline through algorithmic and system optimization
- Own end to end system characterization across a range of hardware
- Own the design and implementation of inference optimizations for AI workloads, targeting peak efficiency on diverse hardware
- Engage in performance benchmarking, profiling, and troubleshooting to improve execution across various hardware
- Work on cross-functional teams to design, implement, and test new features
Qualifications
- 5+ years of hands-on experience in C/C++ development with a focus on performance optimization
- Strong understanding of low level systems and efficiency in the context of high-performance computing
- Familiarity with GPU-based computing and CUDA or similar GPU programming environments
- Solid knowledge of system design and performance optimization techniques
- Experience with open-source contributions and community-driven projects is a plus
Skills
Required:C/C++ performance optimizationLow-level systemsGPU programming (CUDA or similar)Performance benchmarking and profiling
Nice to have:Open-source contributions
Benefits
- Medical, Dental, and Vision benefits
- Flexible Paid Time Off, 10 days
- Parental Leave
- 401(k) Plan with company matching
- Snacks and coffee to keep you energized
Last updated Oct 25, 2026. Interested? Apply on the company site.
About OpenInfer
OpenInfer — Inference OS for the Agentic Era
OpenInfer is the Inference OS for the agentic era — run AI agents on the CPUs, GPUs, and NPUs you already own, at the best cost and speed, with no cloud lock-in.
AI infrastructureCPUsGPUsInference OSNPUsbessemer-ai-infrastructure-2026distributed inferenceedge computing
More open roles at OpenInfer
- AI Model Architecture Optimization Engineer R&D3mo agoSan Mateo, CA · Engineering / AI Acceleration
- Full-Time Engineer: AI Software Engineer3mo agoHybrid (Bay Area, CA)