← All roles

Software Engineering Manager, Google Cloud TPU

Google· Google Cloud TPU
Apply on company site
Tel AvivFull-timePosted 1w ago

About the role

Software Engineering Manager responsible for leading an engineering team dedicated to Google Cloud TPU software services, overseeing architecture and execution of large-scale ML infrastructure and LLM operations from chip level to fleet level.

Responsibilities

  • Build, mentor, and inspire a software engineering team. Cultivate a culture of high performance, innovation, psychological safety, and deliberate career development where every engineer grows.
  • Shape the technical strategy and multi-year product roadmap, aligning team objectives with Google Cloud goals and AI-first initiatives.
  • Drive engineering velocity across the project lifecycle, ensuring predictable, high-quality delivery of scalable features.
  • Drive deep technical decision-making for infrastructure components, fostering code reviews, scalable architecture design, AI-first and data-driven development, while mentoring engineers.
  • Advocate a customer-first mindset, establishing standards for service reliability, performance, and operational excellence, transforming customer requirements into technical solutions, and maintaining a healthy production system.

Qualifications

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development, focusing on building distributed cloud services.
  • 3 years of experience in an engineering management role, guiding software engineering teams, including hiring or team development.
  • 2 years of experience in LLM training or inference, including performance optimizations, distributed execution, GPU or TPU acceleration, or PyTorch, JAX, or TensorFlow programming.

Skills

Required:Distributed cloud servicesLLM training or inferenceLeadership and people management
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Google

Google Search homepage

llmtext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at Google