Site Reliability Engineer
Toronto$125k - $250kFull-timePosted 2mo ago
About the role
Boson AI seeks a Site Reliability Engineer to design, operate, and improve infrastructure for AI training and inference, with a focus on reliability, observability, and scalability in a high-performance AI infrastructure environment.
Responsibilities
- Design, operate, and improve reliable infrastructure for AI training and inference workloads
- Own and automate operational workflows across one or more core areas: networking, compute allocation, storage, GPU/server configuration, or AI platforms
- Build monitoring, alerting, runbooks, and incident-response practices that make systems easier to operate
- Diagnose performance, capacity, and reliability issues across hardware, operating systems, networks, schedulers, and distributed workloads
- Partner closely with ML, research, and platform teams to translate workload needs into practical infrastructure improvements
- Improve provisioning, configuration management, testing, and deployment automation
- Help plan cluster growth, capacity allocation, upgrades, and lifecycle management
- Contribute to a thoughtful reliability culture through documentation, post-incident learning, and pragmatic engineering standards
Qualifications
- 4+ years of experience in site reliability engineering, infrastructure engineering, systems engineering, or a related production-operations role
- Strong hands-on expertise in at least one of the following: Networking (firewalls, switching, routing, ASN/BGP, InfiniBand); Cluster and systems allocation with Kubernetes, SLURM, MAAS; Distributed storage (Ceph); GPU/server administration (CUDA drivers, firmware, BIOS, hardware troubleshooting); AI training or model-serving infrastructure
- Experience operating production systems with a focus on availability, performance, security, and automation
- Strong Linux administration and scripting skills
- A systematic approach to troubleshooting across multiple layers of a complex system
- Clear written and verbal communication skills, including the ability to work effectively with a distributed team
Skills
Required:Site reliability engineeringNetworkingKubernetes / SLURM / MAAS
Nice to have:Distributed storage (Ceph)GPU/server administration
Last updated Aug 31, 2026. Interested? Apply on the company site.
About Boson AI
Boson AI | AI for Humans
Boson AI builds voice agents for business-critical work — speech-to-speech models, real-time avatars, and production TTS in 100+ languages.
Higgs RealtimeHiggs Audio / AvatarBoson WorkspaceEnterprisesVoice experienceAPI DocsAPI ReferencePricing
More open roles at Boson AI
- Developer Relations Manager1w agoHybrid (Santa Clara, CA) · Operations
- Member of Technical Staff - Agent Platform (Agent OS)2mo agoSanta Clara, CA · Engineering
- Frontend Engineer2mo agoSanta Clara, CA · Engineering
- Senior Software Engineer - Systems2mo agoSanta Clara, CA · Engineering
- Machine Learning Engineer - Enterprise2mo agoToronto · Engineering