← All roles

Staff + Senior Software Engineer, Inference Deployment

Anthropic· Software Engineering - Infrastructure
Apply on company site
Hybrid (San Francisco, CA), Hybrid (New York City, NY), Hybrid (Seattle, WA)$320k - $485kFull-timePosted 3mo ago

About the role

Role within Anthropic's Inference team focused on building and maintaining high-performance, compute-efficient inference systems to serve Claude across multiple accelerators and cloud platforms.

Responsibilities

  • Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
  • Develop resilient, flexible systems that adapt in real time to real world events
  • Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators
  • Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads
  • Build and operate production-grade deployment pipelines for releasing new models to users
  • Provide high-performance inference infrastructure that enables researchers to develop next-generation models
  • Integrate new AI accelerator platforms and support inference for new model architectures

Qualifications

  • Significant software engineering experience, particularly with distributed systems
  • Results-oriented, with a bias towards flexibility and impact
  • Willingness to pick up slack, even if it goes outside your job description
  • Desire to learn more about machine learning systems and infrastructure
  • Thrive in environments where technical excellence directly drives both business results and research breakthroughs
  • Care about the societal impacts of your work

Skills

Required:Distributed systems
Nice to have:Load balancing / traffic managementKubernetes and cloud infrastructurePython or Rust

Benefits

  • competitive compensation and benefits
  • optional equity donation matching
  • generous vacation and parental leave
  • flexible working hours
  • lovely office space
Last updated Jul 15, 2026. Interested? Apply on the company site.

About Anthropic

building reliable, interpretable, and steerable AI systems

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

ai-infrastructure-and-developmentliquid-ai-recruiting-targetsetter-30setter-30-2026-q1wing-list-2026wing-list-2026-giga-stage
Company profileWebsite

More open roles at Anthropic