Tagging The Real World: Sekai Camera For The iPhone Is Alive And Very Cool
Serkan Toto
Feb 17, 2009

logo_tonchidotA total of 52 companies launched at last year’s TechCrunch50 conference. Five of them got jury selection prizes, there was one big winner and a very special crowd pleaser: Japan-based Tonchidot’s Sekai Camera, an iPhone app that presents tagged information in the form of a graphical layer over images in the iPhone camera.

Charismatic CEO Takahito Iguchi delivered a memorable demonstration, making the audience go crazy by fending off questions of TC50 judges such as Tim O’Reilly if Sekai Camera really works with the words “Join us!” or “We have a patent!”. The reason for the skepticism: Iguchi’s on-stage show mainly centered on a pre-produced video clip, not an actual product demo. This left people wondering if Sekai Camera isn’t just vaporware for almost half a year during which it seemed like nothing happened. But today I saw the app is real and working – on an iPhone.

sekai_camera_1

Tonchidot organized an invitation-only event at an exhibition in Tokyo today, showcasing a working prototype for the first time. Sekai Camera’s basic concept is still intact: Use the iPhone camera to overlay tags and information onto any object in the real world. Users then need to look through the camera to see icons pop up that contain information on buildings, stores, sightseeing spots or objects.

The prototype I tried out today was a bit buggy but worked as promised, showing tags with information (sounds, pictures and text) on other booths installed in the exhibition hall. Many people speculated how Sekai Camera works technically. The answer is simple: The user’s location is identified through GPS (no cell-tower triangulation or image recognition technology is being used). As the iPhone doesn’t have an internal compass, the direction of where the viewfinder is pointed at can’t be measured: Users need to flick fingers left or right to find relevant tags that are around them (as demonstrated in the video I took below). Tap a tag and the information it contains appears in the form of a window, for example a picture with a comment box below it or a voice message someone left earlier.

sekai_camera_2

sekai_camera_3

Tonchidot today showed they were rightfully chosen as a TechCrunch50 finalist. Sekai Camera is incredibly cool technology even though the prototype version didn’t look as flashy as the previous one shown on video. For a massive land grab, Sekai Camera will have to come up with a viable business model, achieve a critical mass of tags to make the app worthwhile and optimize the technology.

But Tonchidot is working on it. Iguchi said he is in talks with companies interested in contributing commercial tags that could contain anything from ads, coupons to product information for a fee. Tags are also being scraped from various web services such as Yahoo Japan’s Wai Wai Mappu (a community-style map information service). But Sekai Camera also needs user-generated tags – lots of them. While a compass built into a future iPhone model might solve the directional alignment issue, GPS within buildings will most likely remain a problem for quite some time. (For tagging the exhibition hall today, locations were measured through Wi-Fi signals an external service called PlaceEngine provided.).

According to Tonchidot, Japan will be covered with social tags first, followed by the rest of the world. Asked when Sekai Camera will be available for everyone to buy, Tonchidot fellow Masayuki Akamatsu told me: “In 2009, sometime when it’s warm!”. We will stay tuned.

Advertisement
  • Related Topics
Advertisement
  • http://uk.techcrunch.com Mike Butcher

    Fantastic. I knew they’d do it.

  • http://payscroll.com Alfred Toh

    TonchiDot’s Sekai Cameria was the cooling thing ever for TC50 but too bad they did not win. I knew they had a solid business plan.

  • http://www.slideroomblog.com cjagers

    Wow … that kind of tech could change everything. The web is placeless. But mobile exists in place and time, which is fundamentally different. If physical reality could aquire a digital historical overlay, there is no limit to the inventions that could be born. (Of course indoors will always be a problem).

  • http://www.storeside.com Manuel Rappard

    I am still skeptic and guess only believe it if I have in in my own hand. Especially here in NY it would be really beneficial though, cannot wait till more developers but their hands on such an app!

  • http://www.santiagoleon.net/?p=410 Santiago Leon News Site » Blog Archive » Video: Sekai Camera For The iPhone Is Alive And Very Cool

    [...] [...]

  • Tom

    this is total crap. I mean the overlay is just random. Imagine what kind of mess is on the screen when you have hundreds of tags in your surroundings (which you will have in the future for sure). It makes the interface only more complicated than needed. If you want just suff and tags from around you use locly or around me on the iPhone. It is easier to use.

    If you want to have real augmented reality and tags in the real world, go with some serious image recognition technology like http://www.snaptell.com or http://www.kooaba.com. While they are not there yet, they certainly have better chances to achieve it, since they have the core competency in image recognition. The rest is comparably easy.

  • Paul

    And that solid business plan is… spamming TC, maybe?

  • Eric Brown

    Wow, amazing stuff! But like others I am a little skeptical as to how well it works. It seems there is a tremendous amount of room for problems.

  • http://wir-sprechen-online.com/2009/02/17/tonchidot-tagging-the-world/ TonchiDot: Tagging the World « Wir sprechen Online.

    [...] The Sekai Camera of TonchiDot adds layers of tagged information over images in the iPhone camera; http://tr.im/gnze   [...]

  • zell

    While I know this is heresy, I still think the Usability of Microsoft’s new Tag platform has a far better chance of mass use. Any phone with a camera can gain data access to “things,” including SMS and URL lanch. User Generated tagging is dead easy.

    The Sekai platform will eventually require Search and Filters to weed out Tags, rather than a targeted solution. I think Sekai is far too cumbersome for the long-term. A gimmick, is just a gimmick….

    See: http://tag.microsoft.com/SignIn.aspx

  • http://www.facebook.com/people/Daniel_Levine/310034 Daniel Levine

    Can’t the position of the devices accelerometer show which direction it is pointing? I feel like some apps already do this, like the star gazing apps

  • http://googlemapsmania.blogspot.com Keir Clarke
  • http://www.johnjones.me.uk john.jones.name

    thats a really bad platform sorry…

    try http://www.semapedia.org/

    or use a QR code to encode whatever you like works on ALL phones and they do this all the time in japan on adverts…

    not dependent on Microsoft servers redirecting you the data is right there in the image !

    http://en.wikipedia.org/wiki/QR_Code

    regards

    John Jones

  • Tom

    +1 to wondering what happened to Enkin.

    A more useful approach. Did Google buy them out? They’ve gone off the radar for > 1/2 a year

  • zell

    The SEMAPEDIA tags only appear to work with Wikipedia URLs. Maybe I need to dig into “advanced” features, but, it doesn’t appear to have SMS options either, which Microsoft.Tag does.

    Who cares if you’re “dependent on Microsoft Servers,” I presume they are more reliable than most and the Tag service is free.

    The QR code reference is interesting, but, I prefer plug-and-play – someone else already did the work and the Microsoft Mobile App (at least for Blackberry) is dead-easy.

    All this iPhone App elitism is growing tiresome.

  • http://www.everydayux.com/2009/02/17/everydayux-morsels-february-16th-february-17th/ » EverydayUX morsels (February 16th – February 17th) | EverydayUX: Everyday User Experience by alex rainert

    [...] Tagging The Real World: Sekai Camera For The iPhone Is Alive And Very CoolSomeday, when this becomes a reality, it should be awesome. [...]

  • tim

    If this is based on GPS, what does it have to do with the camera? Why not just show a list of the tags associated with your location?

  • http://www.thapsus.org Herbert

    The idea is great, but the realization is bad. Essentially it’s nothing more than a list of location-based links. What is all this buzz about?

  • Anti Matter

    The best performance at TC50 to date. Besides all the laughter their demo was pretty cool recorded or not. It is cool to hear they have some sort of a working demo model.

  • Steve

    Absolutely agree. Sometimes, we just pay too focus on communication barrier instead of in technology it self.

  • Ryan

    What’s the business model exactly? And I assume this works using the location (gps) of all “tagged” people, and requires that they all be running the app at the same time? Obviously this is problematic for the iphone (today).

  • http://www.cameracyte.com/blog/tonchidot%e2%80%99s-sekai-camera-tagging-the-world/ Tonchidot’s Sekai Camera: Tagging the World « CameraCyte

    [...] more information, including video of the Sekai Camera in use, see the TechCrunch at this link. Leave a Comment Click here to cancel [...]

  • MGZ

    Yet again, a review of an iPhone app by TechCrunch which uses APIs that are not permitted by the App Store. (How else are they doing real-time video display? The camera API doesn’t allow it.)

    This is probably the 5th time I’ve seen a video iPhone app discussed here, with no mention of the fact that they won’t be able to get it into the App Store, unless Apple severely changes their policies.

    MGZ

  • http://www.semapedia.org Stan Wiechers

    Semapedia’s (I am co-founder) purpose was to bring the knowledge from the wikipedia to the real world. That’s why the constraint. But it is very trivial to create QR codes with various libraries or via one of the web generators.

    TigTags.com (I am co-founder) provides QR Code/NFC/Datamatrix management and usage analysis.

    Regarding the Microsoft Tags, QR codes can be read by any of the already existing QR code readers. The MS Tags can be very tiny, which is great,but keep in mind that they shouldn’t be too small to be recognized and QR codes can simply contain short URLs. The Microsoft Tags are indirect, they always rely on the MS Server where as QR codes are direct and do not need a resolution server.

  • ajf

    They’re just walking down the view hierarchy for UIImagePickerController to suppress the buttons. There are lots of examples of this in the App Store.

  • http://jp.techcrunch.com/archives/20090217tagging-the-real-world-sekai-camera-for-the-iphone-is-alive-and-very-cool/ 現実世界をiPhoneでタグ化するSekai Camera。プロトタイプも素晴らしい

    [...] [原文へ] [...]

  • http://www.facebook.com/people/Willis_Hsu/697292984 Willis Hsu

    Aye!

  • http://www.rajajasti.com/2009/02/17/mobile-enhanced-navigation-of-the-real-world/ Mobile enhanced navigation of the real world « Raja Jasti’s Blog – Renaissance Thinking

    [...] phone. Now that is a great idea, but I was sceptical because they only showed a video. Now they came out with an iphone app that lets you do that using an iphone. This is an interesting compnay to [...]

  • me

    Wow. That totally kills Nokia Point & Find. Their app sucks ballz.

  • http://www.slideroomblog.com cjagers

    Clearly nobody has a clean “Augmented Reality” app working yet … but the idea is exciting and so few people even seem to be able to understand the concept.

    It is only a matter a time before these companies have polished apps. This is the bleeding edge currently. Once the technology gets worked out, there will be a deluge of invention.

  • http://blog.craaank.de/2009/02/17/bookmarks-for-02162009-2/ Bookmarks for 02/17/2009 | craaank

    [...] Tagging The Real World: Sekai Camera For The iPhone Is Alive And Very Cool Tags: iPhone tag real world web2.0 [...]

  • http://www.gadgetreview.com/2009/02/sekai-camera-iphone-app-brings-real-world-picture-tagging-to-your-fingertips.html » Sekai Camera iPhone App Brings Real World Picture Tagging To Your Fingertips (video) » Gadget Review

    [...] [Techcrunch] [...]

  • http://. Cail

    Idea fantastic – technical execution bad. They should at least implement image recognition that can identify floors, walls, ceilings and buildings using a wire-frame model. Like that they could determine the orientation of the user. Waiting for yet another expensive sensor to be built in is not an option. Until then, things will be plastered with tags so hard these tags aren’t of any use anymore. If not, they have an even bigger problem (i.e. not enough users).

  • Sherwin

    But how are they overlaying new buttons on top of the video? I don’t think that’s possible with the legal API.

  • http://www.gerceklerimiz.com gercekci

    wonderfull…

  • http://www.deanterry.com Dean Terry

    The idea of place based media and data is a new one and will take a while to catch on. This app uses place based user created data but, because there is no compass, the overlay is not based on specific objects – it’s just a floating list ordered by location with a video background. Still, we’ll find some things do not need to be localized, while others do, including new kinds / combinations of information we haven’t thought of because we are still mostly working & thinking from a desktop web model. This project at least pushes us into thinking about micro local media.

  • http://nthambazale.com Clement

    Wow! This is interesting.

  • http://asynchron.net/2009/02/tagging-the-real-world/ Tagging the real world! | Asynchron

    [...] Hier ist nun die erste Präsentation das Prototyp. Tagging The Real World: Sekai Camera For The iPhone Is Alive And Very Cool [...]

  • http://www.fwnetz.de/2009/02/18/techwatch-tagging-mit-sekai-camera/ TechWatch: Tagging mit Sekai Camera : FWnetz – Feuerwehr im Netz

    [...] [TechCrunch] [...]

  • MGZ

    Please share some examples of this.

  • ajf

    Just look in the Photography category at the App Store for examples; 25Shot, GhostCamera, etc… Virtually all the apps there use the same technique.

    There’s some discussion and a sample code here:
    http://techzone.enterra-inc.com/iphone/custom-camera-applications-development-using-iphone-sdk/

  • ajf

    They are using a public API to access the camera, so no problem there… Traversing views is allowed (even suggested at times) and overlaying views is standard practice.

  • http://htttp//blog.landspurg.net tomsoft

    Seems quite disapointing. Agree with previous post, this is no more than geolocalized tag/places displayed on top of overlay video.

    I think that there was much more innovation with simmilar projects on android, working real thanks to embeeded compass…

  • http://www.traffic-internet.net/webmasters/a-lire-ailleurs-du-17-fevrier-au-6-mars_3689.html A lire ailleurs du 17 février au 6 mars | traffic-internet.net

    [...] TechCrunch.com : Tagguer le monde réel avec Sekaï Camera (angl.) L’application iphone Sekai Camera de la société japonaise Tonchidot – sélectionné à [...]

  • http://www.mobilecrunch.com/2009/03/20/sekai-camera-mobile-social-tagging-is-coming-to-android-phones-too/ Sekai Camera: Mobile social tagging is coming to Android phones, too

    [...] biggest business newspaper. There wasn’t an opportunity for a hands-on test this time (I could test Sekai Camera for the iPhone last month), but I was able to take some exclusive pictures and videos for [...]

  • http://artishev.com/internet/tonchidot-vypustil-sekai-camera-na-gphone.html Tonchidot выпустил Sekai Camera на Gphone | АРТищев Андрей Борисович, к.э.н.

    [...] Japan’s biggest business newspaper. There wasn’t an opportunity for a hands-on test this time (I could test Sekai Camera for the iPhone last month), but I was able to take some exclusive pictures and videos for [...]

  • http://buildesignawebsite.com/geodelic-raised-35-million-for-location-aware-recommendations/ Geodelic Raised $3.5 Million For Location-Aware Recommendations | Design Website

    [...] However, it doesn’t go as far as some augmented reality tagging apps such as Layar or Sekai Camera, which add a data layer on top of the view through a phone’s [...]

  • http://www.techcrunch.com/2009/06/22/geodelic-raised-35-million-for-location-aware-recommendations/ Geodelic Raised $3.5 Million For Location-Aware Recommendations

    [...] However, it doesn’t go as far as some augmented reality tagging apps such as Layar or Sekai Camera, which add a data layer on top of the view through a phone’s [...]

  • http://www.thefaredge.com/?p=5557 The Far Edge » Blog Archive » Geodelic Raised $3.5 Million For Location-Aware Recommendations

    [...] required. However, it doesn’t go as far as some augmented reality tagging apps such as Layar or Sekai Camera, which add a data layer on top of the view through a phone’s [...]

  • http://www.mobilecrunch.com/2009/07/10/from-tokyo-demo-of-almost-finalized-augmented-reality-tagging-app-sekai-camera-videos/ From Tokyo: Demo of “almost finalized” augmented reality tagging app Sekai Camera (videos)

    [...] over images in the mobile phone camera. And the Sekai Camera version I saw today was prettier than previous ones and worked (almost) flawlessly during Iguchi’s live demonstration (which lasted about 20 [...]

  • http://www.nostruminc.com/whoweare/ourblog/?p=734 SekaiCamera: ARG app that should blow the roof off of things in a few years… | nostrum, inc.

    [...] was prototyped at TechCrunch’s top 50Conference a few months back and from what was written it was the talk of the conference. You can see the actual [...]

  • http://www.nathancolquhoun.com/2009/02/17/links-for-feb-18-2009 Links for Feb 18, 2009 | Based on a True Story

    [...] This looks like a hardcore app. [...]

blog comments powered by Disqus
Advertisement
Got a tip? Building a startup? Tell us