We’ve just added a great new application under the Tesco.com R&D Team account to the Apple App Store for iPhone – if you are reading this entry on a computer with iTunes, go straight to it here.
This app is the world’s first visual search application that makes the discovery of wine interactive and fun just by sending your picture of a bottle of wine to our server – and if we find it, you can uncover loads of information about the wine, and have the option to buy it!
Have a look at this video we’ve uploaded to YouTube to see it in action:
We’ve been working with visual search specialist Cortexica Vision Systems. They are the creators of a bio-inspired vision system enabling intelligent image recognition using principles derived from the human visual cortex.
I’m excited about this application because of the opportunities that a visual searching mechanism could do. To make it happen, Cortexica have worked out how the human brain interprets the scene they eyes are observing – and Tesco Wine Finder has this technology enabled.
When you look at anything, there is a mass of information to take in, but the human brain is able to filter it out so it can concentrate on what it decides is the important elements. Supposing you are reading this blog entry on your computer screen. Your brain is reading this text – but that’s a tiny fraction of the information your eyes are taking in right now. They can see the rest of your computer desktop, the edge surrounding the screen, the stuff on your desk, your keyboard, your hands and much more. But until I just mentioned those items you probably are not aware that your eyes are indeed seeing them all the time. Your brain has just ‘thrown away’ much of the information your eyes are sending it in order to concentrate on the important bit – the reading of these words.
Cortexia have achieved the same thing – you send it an image and its algorithm works out what the important parts of the image are. The database on the search server that is called by Tesco Wine Finder contains images of a thousand wine labels – but an index that only records the ‘important bits’. When you use Tesco Wine Finder to send the wine label, the server receives the whole (compressed) image but analyses it to find just the ‘important bits’ to send to the search request to match with similar signatures.
From my basic understanding of this technique, you are able to take an image, create a small ‘signature’ representing the ‘important bits’ after which it’s a case of matching one image’s signature with similar image signatures in the database – and overall deal with a lot less data!
The ‘magic’ that Cortexica Visual Search brings is to write computer algorithms that decide what is important in an image to compare it with others – taking into account varying lighting conditions, colours, contrast, sharpness/blurriness, one or more dominant objects in the image, and digital artifacts such as noise and compression side-effects. Of course if you take an image of anything other than a wine label – or if you take an image of a label at an acute angle or in very low-light conditions, the ability to match will be lessened.
So please try out Tesco Wine Finder and let me know what you think – oh and of course you get access to our Tesco Wine by the case store too; choose from over 1,000 wines and champagnes including your in-store favourites as well as award winners and mixed cases. You can stock up and enjoy your wine sooner with next day delivery or choose a 2 hour delivery slot on a day that suits you. Which is nice!