← All roles

Technical Program Manager, Inference

Anthropic· Technical Program Management
Apply on company site
Hybrid (San Francisco, CA), Hybrid (New York City, NY), Hybrid (Seattle, WA)$290k - $435kPosted 4d ago

About the role

Technical Program Manager for Anthropic’s Inference organization, focusing on scaling Claude’s serving fleet, velocity of inference engineering, inference engine orchestration, and performance improvements across hardware and cloud platforms.

Responsibilities

  • Own the programs that scale Claude’s serving fleet across accelerator and cloud platforms, from early direction through delivery.
  • Drive new capacity online end to end, working across compute, infrastructure, security, networking, and inference teams so one person is accountable for the whole path.
  • Build visibility into supply, demand, and utilization with capacity and finance partners, and drive trade-offs among utilization, cost, latency, and reliability to a clear decision.
  • Lead reliability programs and large migrations without disrupting production traffic or research, and make sure incident follow-ups land in team roadmaps.
  • Drive the programs that make inference engineers faster: define the productivity metrics that matter, find the bottlenecks, and improve how software is built, tested, and released across platforms, in step with Anthropic’s central Infrastructure org.
  • Coordinate roadmaps and priorities across the production, research, and safeguards needs that depend on the same teams.
  • Track performance and efficiency work from opportunity to measured impact in production, with correctness held as a release criterion.
  • Own inference readiness for model launches alongside our launch TPMs.

Qualifications

  • 7+ years of experience as a TPM, or in an equivalent engineering or SRE lead role, owning large multi-team infrastructure programs end to end in production distributed systems, ML infrastructure, or cloud platforms.
  • Technical fluency in large-scale serving infrastructure, including request routing and load balancing, autoscaling, capacity planning, cluster orchestration, deployment and rollout, and observability.
  • A working understanding of how LLM inference uses hardware (prefill and decode, batching, caching, compute versus memory bandwidth versus interconnect), or a track record of getting deep in an unfamiliar technical domain quickly.
  • A track record of building program mechanisms from scratch on ambiguous, fast-moving efforts, and of retiring process that has stopped earning its keep.
  • The ability to drive outcomes across organizations you don't manage, with competing priorities and unclear decision ownership.
  • Strong written communication, including plans, reviews, and executive updates that many teams depend on.
  • Low ego and high ownership. You do whatever the program needs, whether that is writing a script, running an incident bridge, or chasing a quota, and you care more about the outcome than about scope or credit.
  • Care about Anthropic's mission and about serving frontier AI safely and reliably.

Skills

Required:Program management across multi-team infrastructureTechnical fluency in large-scale serving infrastructureHardware/domain understanding of LLM inference
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Anthropic

building reliable, interpretable, and steerable AI systems

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

ai-infrastructure-and-developmentliquid-ai-recruiting-targetsetter-30setter-30-2026-q1wing-list-2026wing-list-2026-giga-stage
Company profileWebsite

More open roles at Anthropic