← All roles

Staff Software Engineer, On-Device Machine Learning

Google· Engineering
Apply on company site
Sunnyvale, CA, USA$207k - $300kFull-timePosted 3d ago

About the role

Senior software engineering role focused on on-device machine learning within Google AI Edge, enabling deployment, optimization, and tooling for on-device models across devices and platforms.

Responsibilities

  • Enable one or more areas in Google AI Edge Developer Tools such as AI Edge Gallery (Gemma's showcase app for on-device Gemma 0-day), Developer Device Platform (Device farm with AI, enabling developers to test/eval/deploy apps and models across device), and AI Edge Eval (innovative eval framework for on-device model and harness).
  • Train task-specific models of in-app AI enabling Gemma model/runtime co-design (quantization, conversion), build industry-leading on-device AI solutions (voice translate, generative image editing)
  • Enable tooling of GTM for on-device Gemma 0-day (AI Edge Gallery), helping developers to test/eval/deploy across devices.
  • Enable on-device deployment of key models across various accelerators (GPU/Pixel TPU/NPUs/CPU) on Android, Chrome, and more.
  • Improve performance of on-device model inference via optimizations in the model presentation, on-device runtime and kernel implementation.

Qualifications

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience with software development in C++ programming language.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • 5 years of experience leading ML design and optimizing end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).

Skills

Required:C++Machine Learning design and deploymentSoftware architecture and design
Nice to have:On-device ML deployment

Benefits

  • Learn more about benefits at Google (link provided in description).
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Google

Google Search homepage

llmtext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at Google