Inference Engine Development - Member of Technical Staff
Callosum· Compute & Infrastructure
LondonFull-timePosted 3mo ago
About the role
Role focused on adapting and extending inference engines for heterogeneous hardware, designing scheduling, memory and execution optimizations to enable production-scale, hardware-aware inference across diverse accelerators.
Responsibilities
- Contribute upstream to SGLang and vLLM, and maintain internal forks where our requirements diverge
- Improve hardware-awareness within inference engines so that scheduling, memory management, and execution adapt to the capabilities of the underlying accelerator
- Design and implement bespoke parallelism and disaggregation strategies that go beyond default configurations to better exploit heterogeneous hardware
- Work closely with an Accelerator Systems Software engineer to ensure engine-level abstractions map cleanly onto diverse hardware capabilities
Qualifications
- Deep familiarity with the internals of SGLang, vLLM, or comparable inference serving frameworks - scheduler design, memory management, and execution pipelines
- Strong background in high-performance Python and C++/CUDA systems, particularly in the context of ML inference
- Experience designing or implementing parallelism strategies for large model serving
- Understanding of disaggregated serving architectures and the tradeoffs involved in separating modules of a workflow
- Demonstrable record of working effectively in fast-moving open source codebases with evolving APIs and design conventions
Skills
Required:SGLangvLLMScheduler designMemory managementParallelism strategiesDisaggregated serving architectures
Benefits
- Competitive Salary, determined by skills and experience
- Equity & Ownership
- Private healthcare
- Visa sponsorship and relocation benefits to hire the best in the world
Last updated Oct 14, 2026. Interested? Apply on the company site.
About Callosum
The Intelligent Systems Company.
Callosum - Co-evolving chips & intelligence
AISystems companychipscomputedevelopmentheadline-ai-europe-100-2026heterogeneousinfrastructure
More open roles at Callosum
- Expression of Interest - Internships3w agoLondon · Expression of Interest
- Evolutionary Optimisation - Member of Technical Staff2mo agoLondon · Compute & Infrastructure
- Research Engineer, Benchmarking - Member of Technical Staff2mo agoLondon · Applied AI
- Networking & Interconnect Systems - Member of Technical Staff2mo agoLondon · Compute & Infrastructure
- ML Research Engineer - Member of Technical Staff2mo agoLondon · General Capabilities