AI Operations Analyst
San Francisco, CA$70k - $100kFull-timePosted 8mo ago
About the role
Enterprise-grade AI support reps for call centers. Role focuses on supervising and optimizing AI-powered customer interactions in real time, ensuring quality, intervening when needed, and collaborating with engineering to improve AI performance.
Responsibilities
- Monitor live AI-customer conversations and ensure quality standards
- Make real-time judgment calls on when to intervene
- Step in as the escalation point when customers need a human, de-escalating frustrated customers and resolving complex issues
- Identify patterns in AI performance and document what's working and what's not
- QA new AI experiences before release—interact with them as customers would and flag issues
- Work with engineering to improve the AI based on what you observe
- Build the playbooks and processes for this function as we scale
Qualifications
- Recent college graduate (any field)
- Comfortable being on the phone with customers, including frustrated ones
- Someone who's excited about AI technology AND genuinely enjoys helping people
- Strong judgment and decision-making skills
- Ability to work one weekend day
Skills
Required:Customer support / client interactionReal-time decision makingQuality assuranceAI / ML awareness
Last updated Sep 2, 2026. Interested? Apply on the company site.
About Calltree
Enterprise-grade AI support reps for call centers
Calltree makes enterprise-grade AI support reps for call centers. Our AI reps take voice calls and chats like other AI support agents but can also use internal enterprise tools like a homegrown CRM or internal dashboards, like the highly trained humans working there today.
generative-aisaasb2bcustomer-serviceai