Software Engineer, Applied AI, Model Quality
New York, NY$174k - $252kFull-timePosted 3d ago
About the role
Software engineer role within Google Pics as part of an AI-powered visual editor integrated across Google Workspace. Focus on building evaluation systems for model quality, leveraging GemPix and Gemini image-understanding capabilities, and delivering roadmap-driven features for model assessment.
Responsibilities
- Build both human-powered and Large Language Model (LLM)-powered automated evaluation systems to assess model performance.
- Establish clear metrics to measure aspects like grounding, coherence, safety, and helpfulness.
- Utilize platforms and tools to efficiently run evaluations across different models and datasets.
- Provide actionable insights from evaluations to improve model quality, often in collaboration with research, and cross-functional teams.
- Create tools and systems that make the evaluation process more efficient and effective.
Qualifications
- Bachelor’s degree or equivalent practical experience.
- 5 years of experience with software development in one or more programming languages.
- 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
Skills
Required:Software developmentTesting and evaluation
Nice to have:ML/dl concepts
Last updated Oct 23, 2026. Interested? Apply on the company site.
More open roles at Google
- Staff Network Security Engineer, Google Enterprise Network3d agoHybrid (Austin, TX; Sunnyvale, CA)
- Group Product Manager, Google Lens AI Shopping3d agoMountain View, CA, USA · Product Management
- UX Program Manager3d agoHybrid (New York, NY; San Bruno, CA) · UX Programs & Operations
- Senior Staff Software Engineer, Android Automotive OS3d agoHybrid (Kraków, Poland; Munich, Germany)
- 3d ago