← All roles

Staff + Senior Software Engineer, Inference Infrastructure

Anthropic· Software Engineering - Infrastructure
Apply on company site
Hybrid (SF, CA), Hybrid (NYC), Hybrid (Seattle)$320k - $485kPosted 4mo ago

About the role

Inference team builds and maintains the systems that serve Claude to millions of users, delivering large-scale, compute-agnostic inference deployments across diverse accelerators. Focused on maximizing compute efficiency while enabling breakthrough research through high-performance inference infrastructure and multi-cloud, multi-accelerator orchestration.

Responsibilities

  • Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
  • Develop resilient, flexible systems that adapt in real time to real world events
  • Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators
  • Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads
  • Build and operate production-grade deployment pipelines for releasing new models to users
  • Provide high-performance inference infrastructure that enables researchers to develop next-generation models
  • Integrate new AI accelerator platforms and support inference for new model architectures

Qualifications

  • Significant software engineering experience, particularly with distributed systems
  • Results-oriented, with a bias towards flexibility and impact
  • Willingness to pick up slack, even if it goes outside your job description
  • Desire to learn more about machine learning systems and infrastructure
  • Thrive in environments where technical excellence directly drives both business results and research breakthroughs
  • Care about the societal impacts of your work

Skills

Required:Distributed systems
Nice to have:Load balancing / traffic managementHigh-performance inference / ML systemsKubernetes and cloud infrastructureProgramming languages
Last updated Sep 9, 2026. Interested? Apply on the company site.

About Anthropic

building reliable, interpretable, and steerable AI systems

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

ai-infrastructure-and-developmentliquid-ai-recruiting-targetsetter-30setter-30-2026-q1wing-list-2026wing-list-2026-giga-stage
Company profileWebsite

More open roles at Anthropic