← All roles

Sr./Staff TPM - Inference Capacity

Cerebras· Software Engineering
Apply on company site
Hybrid (Sunnyvale, CA), Hybrid (Remote), Hybrid (Toronto, CAN)Full-timePosted 3mo ago

About the role

Experienced Technical Program Manager to lead capacity planning and fleet strategy for Cerebras Inference Service, coordinating with Engineering, Product, Infrastructure, SRE, Operations, and executive leadership to maximize utilization of the AI inference fleet.

Responsibilities

  • Capacity planning and forecasting. Build and maintain the 6 / 12 / 26-week rolling capacity model across every cluster. Work with product team to translate customer contracts and sales pipeline asks into capacity requirements. Forecast model replicas, system-hours, and spares by customer and by model. Reconcile against actuals weekly. Maintain the source-of-truth doc.
  • New Datacenter Capacity bring-up. Collaborate with datacenter infrastructure and operations teams to support new datacenter bringup and ensure production readiness. Drive engineering efforts and related automation to ensure on-time and quality delivery.
  • Allocation and cluster placement. Partner closely with the SRE and product team to run the weekly capacity review across different customers/models/clusters. Decide model placement and re-balancing: which customer tenants land where, which clusters absorb new launches, which freezes are in effect etc. Run the weekly capacity and utilization report for the Inference Service leadership. Post capacity allocation, drive downstream tasks w.r.t deploying models across the allocated capacity with SRE team.
  • Drive capacity planning tool adoption. Partner with console engineering team to drive stakeholder adoption of the inhouse built capacity planning and allocation tool, including user acceptance testing, issue resolution, tracking changes, pilot testing and deployment. Contribute to continuous process improvement and development of internal capacity management tools.
  • Incident tracking and postmortems. Proactively identify and mitigate capacity bottlenecks, risks, and dependencies. In case of any SLA drop due to capacity misallocations, drive related resolution and postmortem.

Qualifications

  • 5+ years of TPM, technical program management, or product operations experience in cloud infrastructure, large-scale ML serving, or hyperscaler capacity planning
  • Experience leading large cross-functional programs involving Engineering, Product, and Operations
  • Comfort with the inference serving stack: model replicas, batching, prefill/decode, KV cache, accelerator scheduling
  • Strong data fluency: SQL, Grafana, basic Python or Flux to pull your own numbers without waiting for an analyst
  • Track record of running a recurring cross-functional ritual involving senior engineers and LT
  • Direct experience with AI accelerator fleet operations such as Habana, TPU pods, Inferentia, Trainium

Skills

Required:Capacity planning and forecastingData analysis and toolingCross-functional program leadership
Last updated Aug 30, 2026. Interested? Apply on the company site.

About Cerebras

Cerebras is the go-to platform for fast and effortless AI training. Learn more at cerebras.ai.

Cerebras is the go-to platform for fast and effortless AI training.

AICerebras Wafer-Scale Enginechipshardwareinferenceliquid-ai-recruiting-targetmultimodalsetter-30
Company profileWebsite

More open roles at Cerebras