The Unified Database Of Places Is Coming Soon. Or Maybe Never.
MG Siegler
May 8, 2010

Last month, Erick wrote a post calling for the creation of an open database of places. As location-based services continue to gain popularity, each of them is building up these massive databases of places themselves, and this is going to become an issue as services like Twitter and potentially Facebook attempt to federate all this data. And Erick is hardly alone in thinking about this — nearly all the companies involved in the space talk about such an idea enthusiastically, and regularly. Yet no one seems to be doing much about it just yet.

Back in March, I moderated a panel featuring key members of Foursquare, Gowalla, Loopt, Twitter, and Plancast. When I raised the idea of a unified place database, all seemed to be in agreement that it would be a good thing. Even when I brought up that their own place databases were a way to keep their users around, everyone seemed to think there were better ways to do that, and that the benefits of a unified place database would outweigh any costs. Foursquare co-founder Dennis Crowley reiterated that to Erick last month, saying that a “‘Facebook Connect of places’ would be amazing.

This past week, at Web 2.0 Expo, the discussion started up once again, with a different group of people in the space. This time, key members of Twitter, Google, and Brightkite talked about the idea. Of those, Martin May of Brightkite seemed to be the most adamant about it. When moderator Brady Forrest asked if Brightkite could build such a database, May responded with, “We could.” He went on to say that they’ve spoken with several other companies about such an open place project.

May also hinted that Brightkite may open up the data they’ve gotten from Check.in, their service that allows you to check-in to Foursquare, Gowalla, and Brightkite via one application. Because that app has to search each of those services’ databases to find the correct place to check-in at across all three, Brightkite likely has some interesting data tying at least some of these places on the different databases together.

Steve Lee of Google (working on Latitude) jumped in to say that he likes what Brightkite is doing with Check.in, but thinks that it’s still too cumbersome. “There should be a standard, but it’s not without complications,” Lee said. These include technical challenges and licensing issues, Lee noted, saying that it would be difficult for Google to do this because so much of their [place] data is licensed from third parties.

Google is interested in solving the problem, but it’s not easy,” Lee concluded with.

Twitter’s Elad Gil (who came over when Twitter bought GeoAPI) was more much more optimistic about a solution. In fact, he’s positive it will come, and thinks that all of the various location applications need to be prepared when it does with ways to truly differentiate themselves. “All these applications have ot think about how to differentiate. It’s hard to build out the database of locations, but fundamentally the technical problems will go away,” Gil said.

That rings true. But the question remains: who will build it? Twitter seems to be passing the buck to Google, who seems to be passing it right back to Twitter. Brightkite clearly wants to, but will any of the other players really trust a rival with their data? If not, will they start to restrict their APIs to make it harder to access the place information in bulk?

The obvious solution is to have a completely open database, as Erick laid out. But again, that is easier said than done. We’ve seen that time and time again with a number of different initiatives. “Open” sounds great until someone has to actually do it, be in charge of it, and get users to use it.

That leaves the 800-pound gorilla: Facebook.

As they get ready to unleash their location-based component, one that will supposedly integrate with venues, I wouldn’t doubt that they’ll be not-so-slowly gathering up and organizing a massive database of places. They’ll open this up, via the Open Graph API, but everyone will complain that it’s not really open. Then Twitter will step up with their solution (they’ve been accumulating the necessary data for some time now). Then Google will too. It’s amazing what a little competition can do.

Of course, if that happens, we’ll be left with the same problem, just at a higher level. And the dance will continue.

[photo: flickr/pedrosimones7]

Advertisement
Advertisement
  • http://twitter.com/sup3rblogg3rs @sup3rblogg3rs

    web 2 + twitter + facebook
    iam like it
    iam a swedish monkey

  • http://www.cdnpal.com Christopher

    With mothers day coming tomorrow I would like to warn people about FTD.com and it's false promises. http://bit.ly/dzmQxf

    As for the open database of yellow pages, that seems cool, but who wants to build these databases for charity. At the end of the day a lot of man hours and time goes into this, and nobody wants to work for free.

  • http://techretold.com Shan

    If they are going to create it then it's going to give a competitive advantage to only one of them

    About Intense debate comments in Techcrunch:(I have already signed into Facebook on a different tab on the same browser) The problem is I wish to use my wordpress account to post here..And when I sign out of my Facebook account here.. it also signs me out of Facebook main site also..

    whether this is a problem with Intense debate or Facebook…

  • http://hellologic.com Nathan J. Brauer

    These posts are all missing a huge factor.

    Erick wrote a post calling for the creation of an open database of places: http://techcrunch.com/2010/04/17/open-database-pl...

    The Exact same day, Arrington wrote about how OpenStreetMap has exploded in growth: http://techcrunch.com/2010/04/17/cloudmades-opens...

    YOU GUYS MISSED THE LINK!!

    There already IS an open database map which includes a growing database of places. Now we just need a separate API for its places (if it doesn't already exist).

  • Phil

    GeoAPI.com looks interesting from a developer perspective, but ownership by Twitter is problematic. What if Twitter decides that a company which depends on GeoAPI is becoming a significant competitor?

  • Jonathan

    I think you got the focus right at the end: Facebook will dominate location standardization, unless Google gets there soon. Even with Twitter's scale, they don't have the system in place to properly dominate with a centralized check-in location core. Facebook has three to four times the users in the US that Twitter does, and those Facebook users are much more active. Given how slow Google seems to be moving these days in keeping up with the kids (they're now Microsoft circa 2001; recalling how slow Microsoft was compared to a young Google back then), I don't see them outrunning Facebook in doing this right.

    Then it's going to merely be a question of how open Facebook is with their location data.

  • ChrisK

    Gee, Yahoo has just fallen off the map (heh) here. Yahoo! FireEagle started doing this work two years ago … what happened to all that work?

  • Sanjay

    Bah! Here we have a bunch of greedy companies who dream of hoarding all of the spoils of location themselves. Its their own arrogance that feeds this belief that there will be a unified database of places, of course served by their own system.

  • Anna

    the effort should be led by an independent organization, not a private company
    We need something like W3C. I'd not trust much to private companies

  • jennyspinners

    One should always be careful on new services, else you might dwindle yourself into another scam. Hopefully its not the case. Happy mother's day to all!

  • Tony

    Well TC a news is here. Someone has attempted his or her hands on creating Flickr for hand drawings. Yesterday I have received an email from them, as I am a member of a drawing club. It seems to be in non-AJAX version, however, they have placed a notice that soon it would be available in AJAX.

  • Tony

    The sites' URL is figrz.com

  • shane

    Agreed, but the yellopages is also a private company

  • JakiChan

    Well there’s always Feeebase. They’re an open database of all sorts of things.

  • http://baddabean.com/article.php?story=20100509024539731 Creating Reality: Virtualizing the RL Grid – Baddabean.com

    [...] centered around exactly this topic, not sure why, the convos just happened. Also, I just read this TechCrunch article, and as I was discussing the Unified Location Database just last evening, woke up to this being the [...]

  • http://twitter.com/locationary @locationary

    MG, there's actually a bigger reason why the federated database you've proposed won't be built. It's the big "dirty" secret of the industry and it's not immediately apparent. This secret is that everyone's data is dirty. They get it through various channels and the data that's licensed from InfoUSA, Localeze, and Acxiom is mainly sourced from the yellow pages directories and is often 12-18 months old. The data that's crowd-sourced is mixed and non-structured containing commercial places alongside "Grandma's House".

    There's no utility in everyone getting together to dump their dirty data into a massive database. There would be mass duplications, and no system for removing places that had gone out of business. To my knowledge, no company other than Locationary has articulated a solution for how to keep the data clean and to determine which places (and their details) are valid.

    We've created a patent-pending system for using the public to validate local data. We now have over 20 million places seeded and our users are now in over 70 countries, updating around 100,000 places a day. Our system is a global solution and is language agnostic, enabling data that is entered in one language to be searchable in any other. Now that we've seeded the system, we're now in the process of cleaning and bringing everything up-to-date. Our plan is to open it up for free commercial use so that everyone can build their applications, in their own language, using this global database.

    To learn more, follow me on Twitter or Quora, or watch for our upcoming public launch.

  • gregorylent

    place has zero importance … where we are is effect, not cause .. what we need to have happen in our particular moments is the cause, and place shows up when needed .. big over-rated meme in this time, simply because people are looking for the lost key, not where they lost it, but under the street light (nasruddin story, for those who find the description obscure) (most)

  • realestatekhoj

    I have no clue what you meant but I am sure it was funny… I think google has a good lead on location based data, their maps feature is just too good to be beaten by anyone..Twitter most information is not geo relevant as much as google. I just have a feeling google is not going to make a big splash about it but just really silently grow its database..
    http://wp.me/pRpuJ-o

  • http://www.devonvsmith.com/2010/05/foursquares-lack-of-growth-in-theatres/ Foursquare’s (Lack of ?) Growth | 24 Usable Hours

    [...] Wait it out to see who wins the “location war“ [...]

  • http://aaroncole.com Aaron
  • Moe Glitz

    Would love to see this United Database, as long as Google, Facebook or Twitter don't have their finger prints all over it.
    To me both Foursquare and Gowalla suck.
    Maybe Bing Maps could be the chosen one, as their latest updates really rock.

    Or maybe we need a new Start-up to get it right in this location scenario and become a major web player.

  • kosso

    I'm working on doing something like this behindhttp://tagged.at ;)

  • http://vc-list.com/?p=4052 Spotted: Facebook’s Check-In Functionality And New “Places” Tab | Venture Capital & Angel Investors Lists News and Jobs

    [...] databases to build out its own — or if they have already been doing that behind the scenes. As I wrote yesterday, Facebook is likely to be a key component in moving towards a place database that everyone seems to [...]

  • http://www.rockscrusher.com crusher

    the pic is so beautiful.

  • Standardista

    If it was down to a body like the W3C the location database would get updated about twice a decade, nobody would be happy with the final specs they chose and the major market players would all use their own proprietary systems anyway

    Private companies with a money motive get things done, provided their vested interests don't conflict too much with the other companies in the space

  • Moe

    What about SimpleGeo?

  • not going to happen

    If you pull GEO data from Mapquest, Google Maps and Bing – they aren't the same.. often you'll have something located a block or two away from the other.. One may have a business that was there previously but has closed down etc.. Now you get Twitter, Facebook and other located-based services providing their own databases etc.. you'll end up getting different versions of each. How do you confirm that data and which provider has the most up to date data? Big companies like Google, Bing, Yellowpages etc have their own real reasons to own this data. Sure they have APIs to mash things up, but often they too license this data from several providers as well.

    This will never happen as 'one standard' across the web — Too many/big parties involved, each with their own plans to control/own their location data. Good luck, we can't even agree on video or html standards.. you are smokin something if you think this is going to happen as the defacto standard..

  • http://www.factual.com Myron Ahn

    My reactions:

    1) In the short-to-mid term, owning this database could be a huge competitive advantage. In the long-term, competition will create alternatives.

    2) Among the big guys (Google, Facebook, Twitter), the competition is too stiff to rely on one another for the data. Much like the Russians who cut the natural gas supply to the Ukraine due to a disagreement, one big competitor could easily cut the data flow to another.

    3) Among the smaller guys, curating such a database would be a large distraction, unless this is the entire mission of the company. If Google says it is not easy, that's pretty scary.

    4) Like Anna said, if there is a reliable and trusted independent organization which curates the database, companies big and small will be more likely to use and license the data.

    5) Locationary is right, the data is extremely dirty. The curator will need great technologies for cleaning, deduping, and fighting spam.

    6) Local data changes quickly – yesterday's Taco Bell can be today's Thai restaurant. Timely updates (both to the database and to users) is going to be critical for adoption.

    7) Building a business model around the curation of the data will be the challenge for an independent organization.  Will they be able to become a Red Hat, a Mozilla, or a MySQL?

    8) Yes, the picture is beautiful — perhaps MG is a swing dancer?

  • http://vc-list.com/?p=4144 As Facebook Prepares To Launch “Places,” Foursquare Improves “Places” — Coincidence? | Venture Capital & Angel Investors Lists News and Jobs

    [...] out, it’s a smart move for Foursquare to improve the check-in experience. Until we have a unified places database (which may never happen despite a lot of people working on it), the ability to pull up the correct [...]

  • http://cincodata.com/technology/as-facebook-prepares-to-launch-%e2%80%9cplaces%e2%80%9d-foursquare-improves-%e2%80%9cplaces%e2%80%9d-%e2%80%94-coincidence/ As Facebook Prepares To Launch “Places,” Foursquare Improves “Places” — Coincidence? | Technology and Web 2.0

    [...] out, it’s a smart move for Foursquare to improve the check-in experience. Until we have a unified places database (which may never happen despite a lot of people working on it), the ability to pull up the correct [...]

  • http://jp.techcrunch.com/archives/20100511foursquare-places/ Facebookが位置情報機能を実装しようとする中、foursquareは情報表示機能を改善。タイミングの一致は偶然だろうか?

    [...] 競合となるのかあるいは連携していくのかはわからないが、foursquareの今回の改善はチェックイン・エクスペリエンスを向上させるものと評価できる。統合位置情報データベースができるまでは(実現には多くの人の多くの時間がかかる)、適切な情報を素早く提示するという機能は他の位置情報サービスとの差別化を実現することとなるだろう。 CrunchBase Information Facebook Foursquare Information provided by CrunchBase [...]

  • um um

    blah blah local data will flow together, info wants to be free.. the ground war is going to be the fixed stuff, like what name/url can present a unified or coherent geo view of the country.

  • Wello

    geo:// ??

  • MyLocator(tm)

    Open Location is based on a keyword natural language LBS index. a Geo-Rolodex anyone can read, understand and navigate.

  • http://openstreetmap.org Gorm E. Johnsen

    OpenStreetMap,org has adresses, POI, places, borders and other crowd sourced, untainted geodata suitable all sorts of lookups and analysis.

    Example of reverse geocoding: http://nominatim.openstreetmap.org/reverse?format...

  • OnTheGo

    It is coming soon from localeze…

  • Locator

    GeoAPI looks like it's been deadpooled by Twitter…

  • http://www.sbcrusher.net fanggaofeng

    Thank you for your share! Facebook has three to four times the users in the US that Twitter does, and those Facebook users are much more active. Given how slow Google seems to be moving these days in keeping up with the kids (they’re now Microsoft circa 2001; recalling how slow Microsoft was compared to a young Google back then), I don’t see them outrunning Facebook in doing this right.

  • http://www.sbcrusher.net stone crusher

    It’s great tutorial and your technique is so cool.
    Well done go ahead.

  • http://www.crusherwebsite.com/product/vertical_roller_mill.html vertical roller mill

    Thank you for your share!There’s no utility in everyone getting together to dump their dirty data into a massive database. There would be mass duplications, and no system for removing places that had gone out of business. To my knowledge, no company other than Locationary has articulated a solution for how to keep the data clean and to determine which places (and their details) are valid.

blog comments powered by Disqus
Advertisement
Got a tip? Building a startup? Tell us