← All roles

Hardware/Software Co-Design Engineer, Inference

Google· Hardware/Software Co-Design
Apply on company site
Sunnyvale, CA, USA$192k - $278kFull-timePosted 2w ago

About the role

Role focusing on shaping AI/ML hardware acceleration and TPU technology, bridging model architecture innovation with next-generation hardware design, and driving integration of ML research with advanced silicon architectures.

Responsibilities

  • Drive the definition and optimization of the hardware/software stack to enable performant training and serving of large ML models.
  • Collaborate with research and modeling teams to innovate on model architectures, focusing on scaling, quality, and their direct impact on hardware performance.
  • Lead the development of configurable architectural simulators and cycle-accurate performance models to quantify microarchitectural optimizations and evaluate architectural decisions.
  • Conduct system-level performance analysis across highly distributed ML systems, innovating new methodologies to balance compute, memory bandwidth, and inter-chip network requirements.
  • Engage with partners across hardware design, compiler development, and ML research to transition architectural innovations from concept to production.

Qualifications

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related field, or equivalent practical experience.
  • 10 years of experience in computer architecture, chip architecture, or hardware-software co-design.
  • Experience developing systems for performance modeling, simulation, or system analysis.

Skills

Required:Electrical EngineeringComputer ArchitecturePerformance Modeling
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Google

Google Search homepage

llmtext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at Google