← All roles

Inference Performance & Deployment - Member of Technical Staff

Callosum· Compute & Infrastructure
Apply on company site
London£101k - £192kFull-timePosted 3mo ago

About the role

Role focused on bridging Callosum’s internal engineering with real-world performance, systematically characterising production-like conditions, identifying bottlenecks, and guiding production-readiness of heterogeneous inference infrastructure.

Responsibilities

  • Run experiments self-hosting models on cloud instances or on-prem across providers and hardware configurations, systematically characterising performance envelopes
  • Develop and maintain deployment patterns that are reproducible, measurable, and optimised for latency, throughput, and cost
  • Work at the orchestration and routing software that sits above the inference engine - to improve caching, request scheduling, batching, and resource allocation
  • Act as the integration point for the other roles: consume new accelerator support, engine features, and infrastructure upgrades – to provide high-quality feedback on bottlenecks, essential capabilities, and guide the stack optimisations
  • Build and maintain benchmarking harnesses, regression suites, and performance dashboards that give the team a shared view of system health and progress

Qualifications

  • Experience deploying and benchmarking large model inference in production or production-equivalent environments
  • Familiarity with multi-node GPU deployments and associated networking/communication stacks
  • Strong end-to-end performance characterisation skills: able to isolate whether a bottleneck is in the network, the runtime, the memory subsystem, or the model itself
  • Familiarity with serving frameworks like Dynamo, Triton Inference Server, or similar orchestration layers
  • Clear communication skills - able to translate performance data into actionable, prioritised feedback for the teams building the underlying systems
  • A demonstrable disciplined and systematic approach to deployment: reproducibility, measurement methodology, controlled comparisons, etc

Skills

Required:Large model inference deploymentMulti-node GPU deploymentsPerformance characterizationServing frameworksCommunication of performance data

Benefits

  • Competitive Salary, determined by skills and experience
  • Equity & Ownership
  • Private healthcare
  • Visa sponsorship and relocation benefits to hire the best in the world
  • We work in person at our London office. You'll have the tools, space and setup to do your best work, and if you have specific needs, just tell us
Last updated Oct 14, 2026. Interested? Apply on the company site.

About Callosum

The Intelligent Systems Company.

Callosum - Co-evolving chips & intelligence

AISystems companychipscomputedevelopmentheadline-ai-europe-100-2026heterogeneousinfrastructure
Company profileWebsite

More open roles at Callosum