← All roles

Staff + Senior Software Engineer, Inference

Anthropic· Software Engineering - Infrastructure
Apply on company site
Hybrid (Ontario, CAN)Full-timePosted 2mo ago

About the role

Senior/Staff software engineer role focused on building and maintaining large-scale, distributed inference systems for Claude, incl. routing, orchestration across accelerators, and production deployment pipelines.

Responsibilities

  • Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
  • Develop resilient, flexible systems that adapt in real time to real world events
  • Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators
  • Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads
  • Build and operate production-grade deployment pipelines for releasing new models to users
  • Provide high-performance inference infrastructure that enables researchers to develop next-generation models
  • Integrate new AI accelerator platforms and support inference for new model architectures

Qualifications

  • Significant software engineering experience, particularly with distributed systems
  • Results-oriented, with a bias towards flexibility and impact
  • Willingness to pick up slack, even if it goes outside your job description
  • Desire to learn more about machine learning systems and infrastructure
  • Thrive in environments where technical excellence directly drives both business results and research breakthroughs
  • Care about the societal impacts of your work

Skills

Required:Distributed systemsLoad balancing / traffic management
Nice to have:Kubernetes and cloud infrastructurePython or RustMachine learning systems / inference optimization

Benefits

  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
  • Office space for collaboration
Last updated Aug 19, 2026. Interested? Apply on the company site.

About Anthropic

building reliable, interpretable, and steerable AI systems

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

ai-infrastructure-and-developmentliquid-ai-recruiting-targetsetter-30setter-30-2026-q1wing-list-2026wing-list-2026-giga-stage
Company profileWebsite

More open roles at Anthropic