News, Culture & Society

Searching just got even easier: Google may soon let you look up specific items using a screenshot

Searching just got even easier: Google may soon let you look up specific items using a screenshot

  • Googles new 10.61 app could feature Smart Screenshots, report claims 
  • Feature uses updated version of Lens to do optical character recognition
  • It will search the web for similar objects found in the screen shot

Google could soon make searching the web even simpler.

Rumors have suggested that the tech giant is set to add a screenshot search filter to its 10.61 app.

Called ‘Smart Screenshots’, this feature works with an Lens to find similar items online just by scanning your screenshot.

 

Google could add a screenshot search filter to its 10.61 app. Called ‘Smart Screenshots’, this feature works with Lens to find similar items on the web just by scanning your screenshot

When activated, Smart Screenshots will open an updated version of the toolbar, Engadget reported.

Users can still edit, share and choose an app to send the shot, but what brings it all together is the latest version of Lens.

When Lens is selected, you can conduct a search and ‘do optical character recognition (OCR) or find visually similar items’.

Google is also set to use its powerful algorithms to let users rove their photos for text inside an image. 

WHAT IS SMART SCREENSHOT? 

 When activated, Smart Screenshots will open an updated version of the toolbar, Engadget reported.

Users can still edit, share and choose an app to send the shot, but what brings it all together is the latest version of Lens.

When Lens is selected, you can conduct a search and ‘do optical character recognition (OCR) or find visually similar items’.

Its new feature, slated to be rolled out in Google Photos, will allow users to search text that appears in photos and then, more importantly, copy and paste that text into a note or document using Google Lens — its image recognition technology.

In a tweet to venture capitalist Hunter Walk, Google acknowledged the feature which he noted had been turned on in his account.

‘You spotted it! Starting this month, we’re rolling out the ability to search your photos by the text in them,’ said Google in a tweet.

‘Once you find the photo you’re looking for, click the Lens button to easily copy and paste text. Take that, impossible WiFi passwords.’ 

The technology is apparently being rolled out for all users over the course of the next month. 

To use the feature, Walk says users can open the Google photos and select screenshot, select the ‘Lens’ feature, highlight the desired text text, and then choose copy/paste.

The features use a Google technology known as ‘on-screen character recognition’ (OCR) to scan your photos and tag them in the app. 

After its done tagging your photos, users can then input searchers for words that appear in images. 

This allows one to search for things like receipts, passwords, or any other interest that displays a searchable text. 

The fact that entire libraries are now searchable suggest that Google is applying the feature to each and every photo one uploads.

As noted by The Verge, the features seem to hearken back to an initiative in 2017 when Google said it was developing technology that understands the ‘context’ of photos, allowing wielders to automate certain processes like inputting WiFi passwords.

Googles new features will complement other such features of its Google Lens app which allow people to use their cameras to help facilitate web searchers by taking pictures of things like business cards to find company information.

IOCR has also been deployed to catalog users photos by object, recognizing the difference between, say, a dog and flower. In 2018 the company announced that Lens can now identify more than one billion items.



Read more at DailyMail.co.uk


Comments are closed.