Lead Software Engineer, Model Serving Platform
Sciforium· Engineering
San Francisco, CA$230k - $300kFull-timePosted 8mo ago
About the role
Lead the technical direction and execution of Sciforium’s model serving platform, building core high-performance components, mentoring engineers, and shaping the end-to-end AI inference stack from GPU kernels to APIs for real-time multimodal applications.
Responsibilities
- Lead the technical direction of the model serving platform, owning architecture decisions and guiding engineering execution.
- Build core serving components including execution runtimes, batching, scheduling, and distributed inference systems.
- Develop high-performance C++ and CUDA/HIP modules, including custom GPU kernels and memory-optimized runtimes.
- Collaborate with ML researchers to productionize new multimodal models and ensure low-latency, scalable inference.
- Build Python APIs and services that expose model capabilities to downstream applications.
- Mentor and support other engineers through code reviews, design discussions, and hands-on technical guidance.
- Drive performance profiling, benchmarking, and observability across the inference stack.
- Ensure high reliability and maintainability through testing, monitoring, and engineering best practices.
- Troubleshoot and resolve complex issues across GPU, runtime, and service layers.
Qualifications
- Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience
- 5+ years of experience designing and building scalable, reliable backend systems or distributed infrastructure
- Strong understanding of LLM inference mechanics (prefill vs decode, batching, KV cache)
- Experience with Kubernetes/Ray, Containerization
- Strong proficiency in C++, Python
- Strong debugging, profiling, and performance optimization skills at the system level
- Ability to collaborate closely with ML researchers and translate model or runtime requirements into production-grade systems
- Effective communication skills and the ability to lead technical discussions, mentor engineers, and drive engineering quality
- Comfortable working from the office and contributing to a fast-moving, high-ownership team culture
Skills
Required:C++PythonCUDAKubernetesDistributed systemsLLM inference
Benefits
- Medical, dental, and vision insurance
- 401k plan
- Daily lunch, snacks, and beverages
- Flexible time off
- Competitive salary and equity
Last updated Aug 7, 2026. Interested? Apply on the company site.
About Sciforium
Byte-Native AI Models & Infrastructure
Sciforium is pioneering the future of AI infrastructure and research. We're developing byte-native multimodal foundation models while delivering serverless LLM serving at a fraction of traditional costs
More open roles at Sciforium
- Office Manager2d agoSan Francisco, CA · Operations
- Research Engineer - Model Evaluation & MLOps1mo agoSan Francisco, CA · Engineering
- Pre-training Research Engineer1mo agoSan Francisco, CA · Engineering
- GPU Cluster Engineer, Networking2mo agoSan Francisco, CA · Engineering
- GPU Cluster Engineer, Systems & Platform2mo agoSan Francisco, CA · Engineering