Search By Sight With Google Goggles
MG Siegler
Dec 7, 2009

2682404427_2a2375b013Today, at their Search Event in Mountain View, Google demoed a brand new product set to launch in Google Labs: Google Goggles. Humorous name aside, the product looks to be a huge leap forward in the field of visual search — by which I mean, you point a camera at something and Google figures out what it is.

The example that Google VP of Engineering Vic Gundotra showed on stage involved taking a picture of a particular bottle of wine. When he ran it through Google Goggles, the result showed that the particular bottle has a hint of apricots. You also be able to use Goggles to look up things such as CD covers and bar codes (this is likely similar to the popular Android app ShopSavvy). For text, Google Goggles uses optical character recognition (OCR) to try and read things like logos and labels to aid the search.

It seems as if this new functionality, which should be live in Google Labs soon, will be destined for Android phones at least at first.

Screen shot 2009-12-07 at 11.42.55 AM

Screen shot 2009-12-07 at 11.50.20 AM

Update: Google Goggles is now live in Labs. It will be Android-only for now, and it’s available in the Android market.

Here are some videos about the feature:

Update 2: And here’s a live demo we got on video.

[photo: flickr/sakraft1]

Advertisement
  • Related Topics
Advertisement
  • pukerocket

    MG, when are you updating us all on the Crunchpad travesty?

    Mike had all his head honchos working on this thing, apparently. I assume you were involved.

    Are you gonna put your hands up and admit you screwed up?

  • John Stidell

    Sounds very similar to the SnapTell app that’s been available on iPhones for well over a year.

  • Raeb

    Amazing.

  • http://www.leifandersen.net Leif Andersen

    Sheesh, google has been on the move today, announcing new things right and left.

    Still, it would be awesome if Google did make a pair of googly goggles that you can buy, that would help you search for things as you where them. It would be grate for looking for lost items, or finding a particular person in a crowd. Still though, this is a good start.

  • Raeb

    Real-time search just announced..

  • http://www.facebook.com/people/Thomas_McKay/1493487882 Thomas McKay

    Sounds even better than barcode scanning wines. Look for it (some day!) in Wine by the Bar’s apps.

  • Olternaut

    What I want to know is when will Techcrunch make it’s official response to FusionGarage’s joojoo announcement today?

    That is obviously the only REAL techcrunch story today!

  • jon

    They demoed this on the CNBC special last week called “Inside the Mind of Google.”

  • thelazzyone

    The app is in the Android market… Try it out..so far it is ok…not 100% but pretty good!

  • Brad

    hmm.. telling me a wine has a hint of apricots, I think the label will tell me that! I was honestly hoping for something a little more exciting.. like being able to take a picture of my dog and have it tell me it was an English bulldog and then search for information about the breed, as an example.
    *yawn* shop savvy and other bar code searching apps are good enough for this…

  • http://www.facebook.com/people/Erik_Lee_Jorgensen/1432209718 Erik Lee Jorgensen

    How is this different then SnapTell on the iPhone? I have been using it for months. Used it to find a book on metal engraving that was old enough to not have a bar code on it. SnapTell found it by the cover without problem.

  • Shay Guy

    Eden of the East?

  • Ted

    Google Goggles is now live in the Android Market!

  • http://einfachskate.com Josh A. Weston

    If I was blind, I would just walk around with these on.

  • http://www.radmoose.com R. Moose

    What about pointing Google Image Search to an image file and having it tell me where else I can find that image?

  • http://www.facebook.com/people/Mark_AM_Kramer/733157512 Mark A.M. Kramer

    Impressive!

  • Anonymous

    Companies like Kooaba, Snaptell have been providing this technology on both iPhone and Android since 2 years.

  • http://www.yosefsolomon.com Yosef Solomon

    That’s awesome. I’m not very familiar with SnapTell, but doesn’t that only work with amazon.com?

  • http://hook.org anselm

    who owns what the images translate to? what if there are two parties that have contentious ownership over what an image resolves to? is google proposing an imagedns? how do you add images to it?

  • http://thetechnologycafe.com/ Samir

    what i am concerned about privacy of people as not only they could be searched instantaneously also that would we not become too much indulged in the web, even having it on our eyes as walk,

    http://thetechnologycafe.com/goggle-search-by-google-a-new-way-to-search/

  • dr.nik

    A step away from Sixth Sense http://www.pranavmistry.com/projects/sixthsense/ but looks clever. I will probably have to get an android or iphone in the next year or two. This is a big step for a neo-Luddite like me.

  • Luke

    Companies like SnapTell or kooaba offer mobile visual search apps for quite some time now. And they are available on other platforms such as the iPhone.

  • http://www.techcrunch.com/2009/12/07/google-goggles-video/ Video: Google Goggles Live In Action

    [...] one thing for Google to talk about how cool its new Goggles service is, and to show it off in staged demo videos — it’s another to see it in action. Our own [...]

  • Paul

    Yes, indeed. What’s the TC response?

  • John

    this is cool: it’s the same but on the web http://www.photocontext.net

  • Sergej

    yeah, kooaba and snaptell have been doing this for quite a while, suddenly Google does it and NOW it’s amazing …

  • http://www.faceyspacey.com James from FaceySpacey.com
  • maurice

    Is google goggles globally available or only in the US because I can’t find it in the market in the Netherlands

  • http://singpolyma.net Stephen Paul Weber

    Has someone from the US with this installed backed it up (with astro or similar) and made an APK available for download? It seems it’s US-only on the market…

  • Cail

    maybe there’s no comment as there’s a pending case? i doubt mike arrington will swallow all these offenses by that indian company

  • Cail

    it’s Google, stupid!

  • http://sco.tt/ Scott Yates

    Yes, and Red Laser, too.

    What a stretch to say that this is the first non-text search for the phone.

    It’s cool, I guess, to have your phone tell you that the Golden Gate Bridge is the Golden Gate Bridge, but I think iPhone users are just fine now.

    http://www.examiner.com/examiner/x-24816-New-Technology-Examiner~y2009m12d7-Google-Goggles-on-the-iPhone-No

  • jtrav

    Android 1.6+. Yet another app that won’t work on the Hero. HTC better update their shit, soon.

  • http://www.facebook.com/people/Mihnea_Miculescu/501059113 Mihnea Miculescu

    Motion seconded, I can’t find it either

  • http://www.facebook.com/people/Dan_John/747255382 Dan John

    Not available in Canada? I just searched on my Hero and couldn’t find it.

  • Brandon

    That looks awesome! I just submitted my e-mail address… Can’t wait to auto-tag my digital photos.

  • http://www.winniekepala.com WinnieKepala

    When Google launched their voice search, I thought it’ll only be a matter of time until they do visual search.

    Image recognition has been around for awhile. As some of you pointed out SnapTell and some other MMS recognition systems.

    Nevertheless, with Google’s extensive search result database, it will be interesting if this is deployed successfully, complimenting their text and voice search capabilities.

    Kudos to Google.

  • Rick

    Very impressive! It’s apps like this one that may well get me to switch from BlackBerry to Android.

  • http://hawkinson.cloudprofile.com Alex Hawkinson

    Insanely interesting. Like RedLaser coupled with some of the better augmented reality apps. This is just a harbinger of what’s to come. http://bit.ly/7MM0cK

    Within 5-10 years apps like this will become so seamless and reliable that they could completely change the face of commerce.

  • caio

    oh please.. this time google googles what?

  • bobics

    Except SnapTell only works for “books, CDs, DVDs, and video games” (per their own description) and Red Laser only does barcodes.

  • Aaron

    It has been available for Android for a long time as well.

  • Aaron

    Weird.. I’m not able to find it all. What section is it in? Searching ‘google goggles’ shows nothing

  • Aaron

    Oh, 1.6 only. That should have been noted on the article/on the labs page.

  • Jeff

    This is the kind of thing that Apple should be afraid of. Sure there have been loosely related apps like barcode scanners available on the iPhone for years, but Google has access to data and resources Apple and iPhone developers can only dream of. This is just the very beginning.

  • jedi

    it’s sad that anyone can snap your pretty face…and pull you on the web. A sad day indeed

  • Olternaut

    Arrington must have cliimbed the freakin walls after reading or listening about the “official” “joojoo” launch.

  • http://thomaskcarpenter.com/2009/12/08/8-things-that-are-possible-with-google-goggles/ 8 Things That Are Possible With Google Goggles « The Future Digital Life

    [...] Unless you’ve been sleeping under a pile of old Commodore 64s, you’ve heard about the Google Goggle announcement.  The service allows you to use pictures to search the web.  The service is amazing [...]

  • http://www.netbooknews.com/1306/put-on-those-google-goggles-making-our-reality-virtual/ Put on those Google Goggles! Making our reality Virtual! | Netbooknews – Netbooks, Netbook Reviews, Smartbooks and more

    [...] TechCruch was able to get up close an personal with Google Goggles at the Google Search Event. Google Goggles is a new Android App that allows you to take a photo and then get information back on whatever you have caught in your sights!! [...]

  • Pawan

    sounds like a retarded version of 6th Sense !

  • http://www.la-realite-augmentee.fr/actualite/google-realite-augmentee-goggles-android La réalité augmentée – Google se lance dans la réalité augmentée avec Goggles sur Android

    [...] : TechCrunch [...]

  • Fireashes

    Does not work here in USA with my Hero either.

  • Allard

    Can’t find it in the Dutch android market…
    Damnit, again a powerfull google application that only seems to be available in the US?
    GOOGLE WAKE UP: in europa everybody is waiting, why not a global release? (the same goes for the navigator)

  • Allard

    Ah, I see:
    “Available on phones that run Android 1.6+ (i.e. Donut or Eclair)”

    @ HTC: hurry up with Eclair for the Hero please. ;-)

  • http://blog.iqads.ro/2009/12/08/aplicatia-de-visual-search-google-goggles/ Aplicaţia de Visual Search Google Goggles | blogul IQads

    [...] pe Techcrunch. via [...]

  • Igor

    not for Hero :(

  • woo

    SNap tell only works on cd’s etc available in US too so pretty useless in Europe..

  • http://www.facebook.com/people/Joe_Dawson/501760832 Joe Dawson

    I really like this and hope it makes it’s way to the iPhone!

  • http://Daniel-HBK.com/?p=1392 Daniel_HBK – الآن مع “جوجل جوجليز” الصور ستتكلم وتفصح عن معلوماتها!!

    [...] المصدر Subscribe to the comments for this post?Share this on FacebookTweet This!Post this to MySpaceBuzz up!Share this on del.icio.usStumble upon something good? Share it on StumbleUponDigg this!Add this to Google Bookmarks تحت قسم: أخبار تكنولوجيا .style1 { text-align: center; }  [...]

  • http://www.skill-guru.com skillguru

    Isn’t this the augmented reality ?

  • http://oggin.net/work/googlegoggles/ Google Goggles

    [...] Google Goggles може да се изтегли от Android Market (секция Tools) и е съвместимо с устройства с Android 1.6 или по-висока версия. Тия с iphone нека завиждат :-) Android forever !!! [...]

  • G.O.

    +1

  • http://digitalandworthknowingabout.wordpress.com/2009/12/08/google-goggles-half-baked-still-tasty/ Google Goggles: Half-Baked, Still Tasty « digital and worth knowing about

    [...] Here’s a clip TechCrunch shot, which they included in kind of a gushy review of the launch (here). [...]

  • http://s191715151.onlinehome.us/wine/?p=1672 Google’s wine goggles : Wine Blog Reviews

    [...] of an object with your cameraphone Android phone and it will tell you more info on it. TechCrunch reported from the demo yesterday in Mountain View: The example that Google VP of Engineering Vic Gundotra [...]

  • http://wir-sprechen-online.com/2009/12/09/google-search-reinvented/ Google Search Reinvented « Wir sprechen Online.

    [...] Search Reinvented Google goes mobile: Goggles offers image keywording, localisation becomes key, search goes real-time; http://j.mp/6Mu61H [...]

  • http://www.bloggermint.com Franklin Manuel

    Goggles uses Google data center to pull out the information. So primarily nothing to worry about privacy of people, as Google don’t contain normal people’s information

  • Cat in the Hat

    I think Dr. Seus is going to be pretty mad that some one stole his Google Goggles.

  • http://www.culture2.org/roamdigital/?p=92 –+ ROAM DIGITAL +– » Blog Archive » Google Goggles – Makes me want to go android

    [...] Google are doing some very interesting research in to visual recognition … So much for putting up weird codes on billboards. Check out article at TechCrunch [...]

  • http://www.techblogogy.net Dan Thompson

    It may just be me… but this scares me a bit. http://bit.ly/8qIVDu

  • http://gadgetgoods.blogspot.com Gadget New Info

    Wow, excellent. Good information.

  • http://iltriso.wordpress.com/2009/12/10/lettera-aperta-a-google/ Lettera aperta a Google. «

    [...] che scopriamo (praticamente) ogni giorno è disarmante. Wave, Social Search, Real Time Search, Goggles, Living Stories. Potrei andare avanti per [...]

  • http://kulturmanagement.wordpress.com/2009/12/10/technologieeinsatz-im-museum-ersetzt-google-goggles-bald-die-audioguides/ Technologieeinsatz im Museum: ersetzt Google Goggles bald die Audioguides? « Das Kulturmanagement Blog

    [...] nicht nur für Museen interessant ist, eigentlich sind dem Einsatz keine Grenzen gesetzt. Auf Techcrunch finden sich zwei Anwendungsbeispiele, die allerdings nicht aus dem Kunst- und Kulturbereich [...]

  • http://nicewebstyles.com/free-fonts.html Free fonts websites

    its a great tool and Google is the best ever

  • http://www.techcrunch.com/2009/12/11/google-code-freeze/ Google’s Big December Code Freeze

    [...] first day of the Jewish holiday Hanukkah. That could well be why we saw Google Realtime Search, Goggles, and some new mobile search ideas at the event on Monday. While later, Google upgraded Analytics [...]

  • http://www.gamepodunk.com/forum/external-tech-news/9416-google-goggles.html#post54326 Google Goggles – Game Podunk

    [...] Google Goggles Search with google on the go. Google Goggles [...]

  • http://teacherstream.wordpress.com/2009/12/11/google-goggles-visual-search-education/ Google Goggles – Visual Search Education « TeacherStream Blog

    [...] An article by MG Siegler from techcrunch.com (Dec. 7, 2009) Search by Sight with Google Goggles [...]

  • http://technologizer.com/2009/12/11/notable-mobile-apps-of-the-week/ Notable Mobile Apps of the Week | Technologizer

    [...] this week Google Goggles launched to great fanfare. Yet I’m not so sure it’s currently “a huge leap forward in the field of visual search.” Basically, you snap a pic with your Android (1.6 or greater) device and Google does it’s best [...]

  • http://www.techcrunch.com/2009/12/12/this-week-on-techcrunch-le-web-privacy/ This week on TechCrunch: Le Web (le sigh), RIP privacy, the planet of the apps and more

    [...] of Pearl Harbor, the 30th anniversary of my birth – but most importantly of all, for the launch of Google Goggles – the moment when the Internet gained the power of sight. Make no mistake; when your great, [...]

  • http://kevinsblog.net/2009/12/this-week-on-techcrunch-le-web-le-sigh-rip-privacy-the-planet-of-the-apps-and-more/ This week on TechCrunch: Le Web (le sigh), RIP privacy, the planet of the apps and more « Kevin E. Phillips, Sr.

    [...] of Pearl Harbor, the 30th anniversary of my birth – but most importantly of all, for the launch of Google Goggles – the moment when the Internet gained the power of sight. Make no mistake; when your great, [...]

  • http://mohdrafie.co.uk/2009/google-goggles-the-search-revolution/ MOHDRAFIE.CO.UK » Google Goggles, the Search Revolution

    [...] Search By Sight With Google Goggles by Tech Crunch [...]

  • toni

    An alternative mobile visual search company with potential for the iPhone and broader labeling capabilities:
    http://www.iqengines.com/

  • http://outofbottle.com/?p=60 Google’s wine goggles – Out of Bottle

    [...] of an object with your cameraphone Android phone and it will tell you more info on it. TechCrunch reported from the demo yesterday in Mountain View: The example that Google VP of Engineering Vic Gundotra [...]

  • http://susandyer2.wordpress.com/2009/12/16/maps-goggles-and-foursquare/ Maps, Goggles and foursquare « One Kansas Girl

    [...] Google Goggles homepage for more information or this blog post from [...]

  • http://argentinewines.com/?p=21407 Google goggles y el vino : ArgentineWines.Com

    [...] acceder a información extra relativa al objeto fotografiado. En este ejemplo aparecido en el sitio TechCrunch, el vicepresidente de ingeniería de Google, Vic Gundotra toma una fotografía de una botella de [...]

  • http://androgeek.com/free-smartphone-apps-for-winter-sports.html Android and iPhone Apps For Winter Sports |

    [...] video and more via “Search By Sight With Google Goggles“ [...]

  • http://www.brunotrani.info/blog/2010/02/16/google-goggles-getting-ocr-translations/ Google Goggles Getting OCR Translations | bruno trani dot info

    [...] language or a street sign in a foreign country. Google Goggles, which creates search queries based on images instead of typed-in keywords, will soon start to be able to translate from foreign languages using [...]

  • http://193.108.43.185/blogs/mobilenews/archive/2010/02/16/google-goggles-getting-ocr-translations.aspx Google Goggles Getting OCR Translations – Mobile News

    [...] anyone trying to figure out a menu in a different language or a street sign in a foreign country. Google Goggles, which creates search queries based on images instead of typed-in keywords, will soon start to be [...]

  • peetee

    Translation would be nice, I guess, but I would much MUCH prefer Goggles to be a RELIABLE means of capturing contact information from the printed page into my Google Contacts. For that, it’s pretty hit and miss, often failing to complete the OCR sweep before deciding to find something irrelevant that resembles what is obviously just a street address and phone number

    .The expedition: http://bit.ly/google-goggles-expedition

  • http://www.chanatown.net Chanatown

    Works great on the Droid X!

  • http://www.louisvuittonhouse.com/ vuitton bags

    Yes, indeed. What’s the TC response?

blog comments powered by Disqus
Advertisement
Got a tip? Building a startup? Tell us