← All roles

Staff Software Engineer, Inference

Anthropic· Software Engineering - Infrastructure
Apply on company site
London£325k - £390kFull-timePosted 8mo ago

About the role

Role focused on designing, building, and operating distributed inference systems to serve Claude to millions of users, including real-time routing, scaling, and deployment across multiple accelerators and cloud platforms.

Responsibilities

  • Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
  • Develop resilient, flexible systems that adapt in real time to real-world events
  • Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators
  • Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads
  • Build and operate production-grade deployment pipelines for releasing new models to users
  • Provide high-performance inference infrastructure that enables researchers to develop next-generation models
  • Integrate new AI accelerator platforms and support inference for new model architectures

Qualifications

  • Proficiency in Python or Rust
  • Software engineering experience building and operating distributed systems in production
  • Working knowledge of containerized infrastructure (e.g., Kubernetes) and at least one major cloud platform (AWS, GCP, or Azure)
  • Results-oriented, with a bias towards flexibility and impact
  • Willingness to pick up slack, even if it goes outside your job description
  • Desire to learn more about machine learning systems and infrastructure
  • Thrive in environments where technical excellence directly drives both business results and research breakthroughs
  • Care about the societal impacts of your work

Skills

Required:PythonRustDistributed systemsKubernetesCloud platforms
Nice to have:Machine learning systems and infrastructure

Benefits

  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
  • Lovely office space in San Francisco (headquarters)
  • Visa sponsorship support available where possible
Last updated Jul 22, 2026. Interested? Apply on the company site.

About Anthropic

building reliable, interpretable, and steerable AI systems

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

ai-infrastructure-and-developmentliquid-ai-recruiting-targetsetter-30setter-30-2026-q1wing-list-2026wing-list-2026-giga-stage
Company profileWebsite

More open roles at Anthropic