← All roles

Senior Staff Tech Lead Manager, TPU Workload Onboarding and Optimization

Google· AI Engine and Infrastructure
Apply on company site
Hybrid (Singapore)Full-timePosted 2w ago

About the role

Senior Software Manager leading onboarding and optimization for training and serving on TPU NPIs, with responsibilities spanning technical direction, collaboration with ML research and performance teams, and customer onboarding for production workloads.

Responsibilities

  • Act as a Senior Software Manager leading the onboarding for stable stack, and optimization for training and serving solutions on the latest TPU NPIs. Set the technical direction and architect the training/inference serving onboarding and optimization frameworks for our customer needs.
  • Collaborate with the ML research, ML performance, model optimization tooling, and other optimization teams.
  • Ship stable stack to our customers for training/inference optimization solutions on TPU.
  • Prepare and optimize very large reference models, demonstrating state of the art single-host and multi-host inference solutions, especially at large-scale.
  • Work closely with customers to onboard their workloads to production and optimization.

Qualifications

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience with software development.
  • 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 2 years of experience with state of the art training (e.g. Megatron-LM, DeepSpeed) and inference techniques (e.g. TensorRT-LLM, vLLM, SGLang).
  • 2 years of experience in a people management or team leadership role.

Skills

Required:Software developmentML design and optimizationState of the art training/inference techniques
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Google

Google Search homepage

llmtext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at Google