Quality Lead, YouTube Global Vendor Operations
Google· YouTube Global Vendor Operations
Hybrid (Hyderabad, Telangana, India)Full-timePosted 4w ago
About the role
Design and lead quality frameworks for YouTube's global vendor operations, focusing on AI QA performance, human–AI collaboration, and stratified sampling to improve vendor quality across geographies.
Responsibilities
- Design Quality Lead (QA) Frameworks to ensure alignment with key business outcomes. Monitor AI QA model performance and accuracy using metrics such as Precision, Recall, and Human Inter-rater Agreement.
- Manage the ingestion of human-validated Golden Labeling from manual overrides to drive continuous, high-fidelity model retraining.
- Implement blind review protocols and complex multi-tiered human + AI arbitration to prevent Automation Bias.
- Design stratified sampling methodologies that prioritize high-risk or ambiguous interactions (e.g., cases where AI confidence is low) for human review.
- Partner with the training team to remediate quality gaps.
Qualifications
- Bachelor's degree or equivalent practical experience.
- 5 years of experience identifying process issues or working with cross-functional teams.
- 5 years of experience with contact center metrics and QA methodologies.
Skills
Required:QA frameworks designAI QA model monitoringGolden labeling ingestion
Last updated Oct 23, 2026. Interested? Apply on the company site.
More open roles at Google
- Staff Network Security Engineer, Google Enterprise Network2d agoHybrid (Austin, TX; Sunnyvale, CA)
- Group Product Manager, Google Lens AI Shopping2d agoMountain View, CA, USA · Product Management
- UX Program Manager2d agoHybrid (New York, NY; San Bruno, CA) · UX Programs & Operations
- Senior Staff Software Engineer, Android Automotive OS2d agoHybrid (Kraków, Poland; Munich, Germany)
- 2d ago