← All roles

Performance Engineer, Inference Systems

Anthropic· AI Research & Engineering
Apply on company site
Hybrid (San Francisco, CA), Hybrid (New York City, NY), Hybrid (Seattle, WA)$350k - $850kunknownPosted 5mo ago

About the role

Role focused on cross-layer performance, correctness, and observability for Anthropic’s inference fleet (Claude) across hardware platforms and serving configurations. Combines performance engineering with correctness checks to optimize throughput, latency, reliability, and cost.

Responsibilities

  • Run cross-layer performance investigations across throughput, latency, and reliability, sizing the gap between actual fleet performance and theoretical rooflines, identifying root causes, and quantifying the value of closing them
  • Own and improve the correctness evaluation pipeline that validates model output quality across hardware platforms, numerics, and serving configurations, and lead the investigation when it catches a regression
  • Build the observability, dashboards, and modeling tools that make throughput, latency, cost, reliability, correctness, and their interactions legible across the stack
  • Partner with kernel, serving, routing, autoscaling, and capacity teams to prioritize and land the highest-impact optimizations your analysis surfaces
  • Ruthlessly stack-rank a large surface area of opportunities by impact and effort, and say no to the ones that don't make the cut

Qualifications

  • Hands-on performance engineering experience: profiling, roofline analysis, latency/throughput optimization, and root-cause investigation in complex production systems
  • Proficiency in Python, with the ability to read, instrument, and contribute to large production codebases you didn’t write
  • Solid data analysis skills (e.g. SQL, pandas, or similar) sufficient to turn raw telemetry into clear findings
  • Ability to communicate quantitative results clearly in writing to influence priorities on teams you don't manage
  • Genuine interest in correctness as an engineering discipline: numerics, evaluation design, regression detection

Skills

Required:Performance engineeringPythonData analysisCommunicationCorrectness in engineering

Benefits

  • Competitive compensation and benefits
  • optional equity donation matching
  • generous vacation and parental leave
  • flexible working hours
  • lovely office space
  • visa sponsorship support
Last updated Jul 8, 2026. Interested? Apply on the company site.

About Anthropic

building reliable, interpretable, and steerable AI systems

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

ai-infrastructure-and-developmentliquid-ai-recruiting-targetsetter-30setter-30-2026-q1wing-list-2026wing-list-2026-giga-stage
Company profileWebsite

More open roles at Anthropic