Software Engineer III, AI/ML
New York, NY$147k - $210kFull-timePosted 3d ago
About the role
Software Engineer III, AI/ML at Google (New York, NY) focused on Gemini Encoder-heavy models, contributing to encoder-heavy frameworks and training recipes for model efficiency.
Responsibilities
- Write product or system development code.
- Collaborate with peers and stakeholders through design and code reviews to ensure best practices amongst available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
- Contribute to the development and optimization of an encoder-heavy framework based on Gemini.
- Engineer innovative training recipes to maximize model efficiency, specifically targeting latency, memory footprint, and compute.
- Communicate with stakeholders to triage technical issues and develop new features that address evolving client needs.
Qualifications
- Bachelor’s degree or equivalent practical experience.
- 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
- Experience developing, modifying, or training core internal Transformer components (e.g., custom/sparse attention mechanisms, sequence compression, Mixture-of-Experts, or encoder/decoder backbones) for foundation language models.
- Experience with pre-training or fine-tuning language and multimodal embedding models using techniques such as Supervised Fine-Tuning, contrastive learning, or parameter-efficient methods.
- Experience with neural network compression and accelerator-level (GPU/TPU) inference optimization (e.g., quantization, structured/expert pruning, or memory-latency trade-off tuning).
Skills
Required:Software developmentTransformer architecturesTraining and fine-tuning of language/multimodal models
Benefits
- Learn more about benefits at Google (link provided in description).
Last updated Oct 23, 2026. Interested? Apply on the company site.
More open roles at Google
- Staff Network Security Engineer, Google Enterprise Network3d agoHybrid (Austin, TX; Sunnyvale, CA)
- Group Product Manager, Google Lens AI Shopping3d agoMountain View, CA, USA · Product Management
- UX Program Manager3d agoHybrid (New York, NY; San Bruno, CA) · UX Programs & Operations
- Senior Staff Software Engineer, Android Automotive OS3d agoHybrid (Kraków, Poland; Munich, Germany)
- 3d ago