← All roles

Staff Software Engineer, Inference Performance Optimization, GenAI, DeepMind

Google· DeepMind
Apply on company site
Mountain View, CA, USA$207k - $300k + bonusfull-timePosted 3w ago

About the role

Software Engineer role focused on optimizing AI model inference at scale, with responsibilities spanning systems profiling, throughput and latency optimization, and development of tools and metrics to maximize hardware performance for large-scale AI inference.

Responsibilities

  • Analyze and optimize AI inference workloads across the application, model, and distributed fleet infrastructure layers to methodically increase throughput-per-GPU and reduce latency.
  • Design and implement inference optimization techniques.
  • Investigate and resolve complex model inference performance bottlenecks across the stack.
  • Model the latency-to-cost impacts of system variables (such as batch-sizing and utilization goals) and translate these insights into actionable signals that drive production systems.
  • Develop investigative tools and metrics (e.g., compute/FLOPs funnels) that track where compute is spent across the fleet.

Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related technical field, or equivalent practical experience.
  • 8 years of experience in software development.
  • Experience in Python and C++, including navigating, debugging, and modifying serving codebases.
  • Experience with AI model execution constraints, throughput-latency tradeoffs, memory bandwidth limitations, and modern serving architectures.

Skills

Required:PythonC++
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Google

Google Search homepage

llmtext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at Google