← All roles

Group Product Manager, AI FinOps and Model Routing

Google· Google Cloud / Product Management
Apply on company site
Hybrid (Sunnyvale, CA; Kirkland, WA; Seattle, WA)$240k - $333kFull-timePosted 1w ago

About the role

Group Product Manager responsible for end-to-end product goal, strategy, and execution for Google Cloud's Token Management and Intelligent Model Routing platform, bridging networking frontiers with LLM runtime intelligence and leading cross-functional efforts in FinOps, compliance, and enterprise-scale routing.

Responsibilities

  • Establish a bi-modal product strategy that serves application developers (integrations with AI Studio, Firebase, and open-source frameworks) while meeting FinOps, compliance, and multi-tenant demands of large enterprises.
  • Drive market positioning and competitive differentiation against point solutions and hyperscaler native gateways.
  • Lead methodology and standards for auto-router benchmarking, agentic evaluation datasets, and real-time routing optimization.
  • Analyze multi-objective routing strategies, optimizing across cost, latency, contextual quality, and model family availability.
  • Define strategy for agentic workload optimizations, planning loops, multi-turn tool calling, and agentic harnesses; identify opportunities for intelligent routing within agentic graphs (e.g., intent classification, step-level model selection, context summarization routing, verification loops).

Qualifications

  • Bachelor's degree or equivalent practical experience
  • 10 years of experience in product management or a related technical role
  • 5 years of experience taking technical products from conception to launch (e.g., ideation to execution, end-to-end, 0 to 1)
  • Experience with API gateways, cloud networking, distributed proxy architectures, API management (APIM), or enterprise observability/telemetry platforms
  • Experience with Generative AI architectures and LLM APIs, tokenization mechanics, semantic caching, prompt chaining, reasoning loops, and multi-agent frameworks

Skills

Required:Product managementCross-functional leadershipAPIs and API managementCloud networking and distributed proxy architecturesGenerative AI architectures & LLM APIs

Benefits

  • Health, dental, vision, life, disability insurance
  • Retirement Benefits: 401(k) with company match
  • Paid Time Off: 20 days vacation per year (accruing 6.15 hours per pay period for first five years)
  • Sick Time: 40 hours/year (69 hours/year in Seattle) including 5 discretionary sick days per instance
  • Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
  • Baby Bonding Leave: 18 weeks
  • Holidays: 13 paid days per year
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Google

Google Search homepage

llmtext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at Google