Google has announced a significant update to its search capabilities on iOS, introducing a new visual search feature that allows users to search what's on their screen with a simple gesture. This feature, similar to Android's "Circle to Search" functionality, enables users to quickly perform a visual search while browsing without taking a screenshot or opening a new tab.
The feature is powered by Google Lens, which allows users to search what's on their screen by drawing, highlighting, or tapping something. For instance, if a user comes across an image of an interesting art piece, they can circle or tap on the image to learn more about it. Similarly, if they're watching a video and see an item they like, they can use Lens to find something similar by circling it.
The idea behind this feature is to provide users with a seamless way to perform a visual search while browsing, eliminating the need to take a screenshot or open a new tab. However, this update also has implications for Google's traditional web search business, which could be impacted by the adoption of AI technology over the long-term.
Once a user highlights or taps something on their mobile device's screen, they'll be shown visual matches and other related results. They can then tap the "Add to your search" option to refine their search by color, brand, or another detail. Additionally, users can ask a follow-up question to learn even more about a topic.
To access the new feature in the Chrome or Google app, users need to open the three-dot menu and select "Search Screen with Google Lens." In the coming months, users will be able to access the feature through a new Lens icon in the address bar, Google says.
The update will continue to roll out this week and will be available globally on iOS. This move marks a significant expansion of Google's visual search capabilities, which have been available on Android devices for some time.
In addition to the visual search feature, Google also announced that it's expanding AI Overviews to more of its Google Lens search results. AI Overviews display a snapshot of information at the top of the results page, providing users with a quick summary of the topic they're searching for.
Previously, Google displayed AI Overviews in Lens searches that included both images and text. With this latest update, users will begin to see AI Overviews without adding additional text or questions to their searches. For instance, if a user takes a picture of an interesting-looking car, they can get an AI Overview to help them quickly learn more about what they're looking at, and get links to helpful resources on the web.
This update is rolling out this week for English-language users in countries where AI Overviews are available, starting with the Google app for Android and iOS. The update will soon roll out to Chrome on desktop and mobile devices, the company says.
The expansion of AI Overviews and the introduction of visual search on iOS demonstrate Google's continued efforts to improve its search capabilities and provide users with more intuitive and efficient ways to find information. As AI technology continues to evolve, it will be interesting to see how Google's search business adapts and evolves to meet the changing needs of its users.