Google I/O 2024: What is Ask Photos, Google’s AI-powered image search feature

Google, at its I/O 2024 developer conference, has announced that the Photos app will get the Ask Photos, an AI-powered feature that will allow users to find specific images in their gallery through natural language queries. The feature will be accessible through a new tab in the app, and will initially be available in the US this summer, with more capabilities to come.
Users will be able to interact with the Gemini AI in the Photos app by typing questions, such as “show me the best photo from each national park I've visited.” The functionality will use the GPS data as well as AI to make judgments in determining the “best” photo. Google says there are 6 billion photos in Google Photos and that Gemini AI will make searching through them easier.
Users can also request assistance in finding top photos from vacations and generating captions for them for quick social media sharing.

Ask Photos builds upon existing AI capabilities in Google Photos, which already allows users to search for specific objects or people using facial and object recognition algorithms. The difference between the already available AI features and Gemini AI-powered features is that the latter introduces generative processing, enabling the app to go beyond simply delivering pictures with certain elements.

According to the company, the queries punched-in by the users will not be stored and conversations will not be reviewed by humans except in rare cases to address abuse. Additionally, Google assures users that no personal data from Ask Photos is used to train other Gemini models or products.