At their SearchOn event today Google announced new Google Lens features which are helpful in Search, Shopping and Education.
Visual tools to help you learn
With Google Lens, you can search what you see using your camera and Google Lens can now recognize 15 billion things—up from 1 billion just two years ago—to help you identify plants, animals, landmarks and more. If you’re learning a new language, Lens can also translate more than 100 languages, such as Spanish and Arabic, and you can tap to hear words and sentences pronounced out loud.
From the search bar in the Google app on Android and iOS, you can use Lens to get help on a homework problem. With step-by-step guides and videos, you can learn and understand the foundational concepts to solve math, chemistry, biology and physics problems.
New AR tools bring hands-on learning home, letting you explore concepts up close in your space for instance, visualizing the inner workings of a plant cell or the elements in the periodic table in 3D.
Shop what you see with Google Lens
Another area where the camera can be helpful is shopping—especially when what you’re looking for is hard to describe in words. With Google Lens, you can already search for a product by taking a photo or screenshot. Now, Google is making it even easier to discover new products as you browse online on your phone. When you tap and hold an image on the Google app or Chrome on Android, Lens will find the exact or similar items, and suggest ways to style it. This feature is coming soon to the Google app on iOS.
Lens uses Style Engine technology which combines the world’s largest database of products with millions of style images. Then, it pattern matches to understand concepts like “ruffle sleeves” or “vintage denim” and how they pair with different apparel.
Bring the showroom to you with AR
When you can’t go into stores to check out a product up close, AR can bring the showroom to you. If you’re in the market for a new car, for example, you’ll soon be able to search for it on Google and see an AR model right in front of you. You can easily check out what the car looks like in different colors, zoom in to see intricate details like buttons on the dashboard, view it against beautiful backdrops and even see it in your driveway. Google is experimenting with this feature in the U.S. and working with top auto brands, such as Volvo and Porsche.
AR experience of the 2020 Volvo XC40 Recharge
Read more announcements from their SearchOn event here.
Get new content delivered directly to your inbox.