Google Lens can now help users decide what to order at a restaurant by showing pictures and reviews of dishes from a menu. It can also automatically translate text into over 100 languages simply by pointing the camera. Recipes come to life through augmented reality by overlaying instructions on top of printed recipes. Google Lens is also available through Google Go to allow visually impaired users to access information simply by listening to text read aloud. Finally, Google is working to incorporate augmented reality into visual search results to allow users to interact with objects like shoes in 3D.

1. 5 GOOGLE LENS
ANNOUNCEMENTS
GOOGLE I/O 2019
DAY ONE KEYNOTE

2. WHAT?
Point Google Lens at a restaurant menu, for
example, and it will show pictures of the dish
along with customer reviews from Google
Maps.
Google isolates dishes from descriptions on
the menu and searches for this text
alongside the restaurant name to find
relevant posts.
HOW?
SO WHAT?
Google Lens can help you decide what to
have for dinner.
1. Visual answers
from Google Maps.

3. 2. Automated
translation in 100+
languages.
WHAT?
Direct Lens at some text and it will detect the language,
then translate and overlay the text in your native language.
Google Translate and Augmented Reality enable Lens to
identify, translate, then display the information.
HOW?
SO WHAT?
It's now even easier to get by in the world without speaking
another language.

4. 3. Recipes come to life.
WHAT?
Show Lens a recipe in a magazine and it will show you how
to make it, step by step.
Initially through partnerships (with 'Bon Appetit' in the
example to the left) that use AR to overlay instructions, but
it is easy to see YouTube integration on this front in the near
future.
HOW?
SO WHAT?
No more wondering how much 'a sprinkle of salt' is - the
chef will show us right in front of our eyes.

5. 4. Google Lens in
Google Go.
WHAT?
Lens can read out text in Google Go, the app for "first-time
smartphone users". This will be available on all Android
phones and will use only a small amount of data.
This is an extension of other Google features but is
significant in that will allow people to listen to the world, as
well as see it. Very valuable for the 750+ million adults
worldwide who are illiterate today (UNESCO).
HOW?
SO WHAT?
More people can access digital services and interact with
the world, through visual and voice search.

6. 5. Augmented Reality
in visual search.
WHAT?
Click on images in search results to interact with them in
3D. This can work through traditional text search or visual
search.
Google is partnering with a few companies (including New
Balance) to implement these AR features in search. Apps
like Wanna Kicks have launched similar technology, but
they don't have the user base and product suite Google has.
HOW?
SO WHAT?
According to Google's image (left), you can commit all
manner of sanitary faux-pas and put your virtual shoes on
the bed.