One Practical Use Case for AI Natural Language Processing: Searching Photos with Conversational Prompts
One practical use case for AI natural language processing is being able to search your photos with the ease of a conversational prompt. As a result, Google unveiled a feature called Ask Photos last year and started rolling out early access to users via Google Labs in September. The feature finally rolled out to me, and the results were surprising.
Search Terms vs. Conversational Prompts
I was excited to try it out for myself. Even though I am a long-time iPhone user, I’ve used Google Photos for about a decade for the additional photo storage and the impressive search interface. Even though the classic search experience isn’t marketed as an AI feature, it has always been super efficient and better than those found on alternatives like Apple Photos.
The Classic Search Experience
With the classic search in Google Photos, I could search terms like "cake," "hot dog," "red dress," or "beach trip," and it would filter through my many photos and find the results instantaneously. With Google Photos already setting such a high bar, I expected the AI-enhanced Ask Photos to exceed my expectations.
Ask Photos: A Promising but Flawed Feature
It did not. However, the feature has promise, and here are some ways Google can improve it. (I also include some tips on getting the most out of Ask Photos today.)
1. Differentiate it from the Classic Search Experience
To get started, in Ask Photos I searched "photos of me as a baby" and was met with the message, "I didn’t find any photos of you as a baby, but I might have missed them!" However, when I typed in the search "baby photos," much like the classic search, it was able to show me all the pictures of babies in my library, which included the ones of me I was looking for. Even though I was able to pull up the photos I wanted, to get there, I had to search the same key term I regularly do in classic search. The result was I wasted my time trying to use conversational terms rather than thinking of a keyword that populates what I was looking for.
2. Make Ask Photos Significantly Faster
Don’t let my first point dissuade you entirely from using Ask Photos. In some cases, it was actually helpful. For example, when I asked it to show my pictures of a Corgi, it pulled up all the pictures in my library of the dog and even told me his name and a bit about his activities. Similarly, when I asked it to show me pictures of the food I cooked, it brought up many homemade meals I’d made over the years. However, one issue remains even when Ask Photos displays the intended results — speed. Ask Photos lags a couple of seconds, even when populating the same results as a classic search in response to a simple query.
3. Expand the ‘Beyond Search’ Offerings
When the Ask Photos feature was launched, one of the selling points was being able to use it beyond search, for example, to create a highlight of special moments from your camera roll using a conversational prompt. Although this is a cute feature, and it worked when put to the test, it doesn’t seem like a significant enough win to convert users to Ask Photos. I think Google has many opportunities to leverage its other AI offerings to build more unique experiences. Perhaps a user could use the Ask Photos feature to ask Gemini to remove an element from the background, insert a new element, add a filter, etc. Most people probably will not have an everyday application for creating a video montage, but saving time editing a photo seems more practical.
How to Access and Un-Access Ask Photos
Ask Photos is still an experimental feature, so to get access you have to join the waitlist. You can join the waitlist by going to the Google Photos page, scrolling down to the Ask Photos section, entering your Gmail address, and clicking the "Join the waitlist" button. If you prefer the classic search, you can either temporarily revert back by clicking "Switch to classic search" on the Ask page. If you want to shut it off temporarily, you can click on your profile picture in the upper right-hand corner, Google Photos settings, Preferences, and Gemini features in Google Photos. Then toggle off the "Search with Ask Photos" feature.
Conclusion
Ask Photos is a promising feature, but it still has some significant limitations. To make it truly worth it for users, Google needs to differentiate it from the classic search experience, make it significantly faster, and expand its "beyond search" offerings.
FAQs
Q: How do I get access to Ask Photos?
A: You can join the waitlist by going to the Google Photos page, scrolling down to the Ask Photos section, entering your Gmail address, and clicking the "Join the waitlist" button.
Q: How do I un-access Ask Photos?
A: You can either temporarily revert back by clicking "Switch to classic search" on the Ask page or shut it off temporarily by clicking on your profile picture in the upper right-hand corner, Google Photos settings, Preferences, and Gemini features in Google Photos, then toggling off the "Search with Ask Photos" feature.
Q: Is Ask Photos available on all devices?
A: Ask Photos is currently only available on Android devices.
