The Googlers Behind Pubsubhubbub Are Back At It With Camlistore. Open Sync, Store, Share

Mg Siegler

MG Siegler is a general partner at Google Ventures and a columnist for TechCrunch, where he has been writing since 2009. Previously, MG was a general partner at CrunchFund. And before TechCrunch, MG covered various technology beats for VentureBeat. Originally from Ohio, MG attended the University of Michigan in Ann Arbor, MI. He’s previously lived in Los Angeles where he worked... → Learn More

Saturday, January 29th, 2011

You may recall that back in the summer of 2009, there was a lot of hubbub over a Google 20 percent project with a near impossible name: Pubsubhubbub. Creators Brad Fitzpatrick and Brett Slatkin actually unveiled it at our Realtime Stream CrunchUp back then. And it garnered a lot of buzz for a good reason: it aimed to speed up traditionally slow feeds of information to realtime. Well, now the two are back at it again (with a few other contributors) with a new project: Camlistore.

First of all, aside from the fact that I keep typing “Camilstore”, this name is a significant improvement over the last project. It’s an acronym for “Content-Addressable Multi-Layer Indexed Storage”. But more importantly, the project once again looks to be a very interesting one. Though the team is quick to note on its homepage that it’s “not ready for users”, the site has quite a bit of information about the general hopes for the project and how they imagine it working.

So what is Camlistore? As the team’s first bullet point notes, it’s “a way to store, sync, share, model and back up content”. Farther down, they also call it your “home directory for the web”. Naturally (from these guys), it’s also entirely open source.

So it sounds like it could be a potential competitor for a few things, namely, Dropbox (and the like), Amazon S3, and MySQL. The group addresses the latter two right on the homepage. They note that it’s “not necessarily” a replacement for S3, and that it’s “not yet” a MySQL alternative. They also say it’s both “cloud” and “local”, which again sounds a bit like Dropbox, though they don’t bring up that service or any of its direct competitors.

As for the competition angle, they want to make it very clear that this is not an official Google project — as they say, it’s “not Google-centric nor endorsed by Google (other than them letting us open source our side project)”. Humorously, they also note that it’s “pro-paranoia and privacy”.

Long story short, it appears we’re going to have to wait a bit to see what it evolves into. But it certainly sounds ambitious at this point.

And it’s definitely worth following given that Fitzpatrick is not only behind Pubsubhubbub, but also Memcached (which he first developed for his startup LiveJournal), and the equally ambitious WebFinger.

The full team behind Camlistore is Brad Fitzpatrick, Brett Slatkin, Dan Erat, Evan Martin, Adam Langley, and Andrew Gerrand. And they’re encouraging others to help them out.

Product: Pubsubhubbub
Website: code.google.com
Company Google

PubSubHubbub is an open, server-to-server web-hook-based pubsub (publish/subscribe) protocol as an extension to Atom, designed to speed up RSS and improve its competitive edge. Parties (servers) speaking the PubSubHubbub protocol can get near-instant notifications (via webhook callbacks) when a topic (Atom URL) they’re interested in is updated. These hubs are decentralized and not directly related to any specific company.

→ Learn more

Brad Fitzpatrick originated the OpenID protocol in 2005 while working at Six Apart, which he started in 1999. He’s also known creating memcached, MogileFS (a GFS-like filesystem), djabberd (a Jabber server), Gearman (and RPC balancer), and other open source backend software. He now works at Google. Microsoft Corp was briefed under a non-disclosure agreement on the OpenID architecture by David Gale in 2004-5. Fitzpatrick claimed to be the originator of the OpenID architecture just three weeks after a formal complaint was logged...

→ Learn more
Person: Brett Slatkin
Website: onebigfluke.com
Companies: Google

Brett Slatkin is a software engineer at Google. He is the engineering lead on Google Consumer Surveys. He formerly worked on App Engine and is the co-creator of the PubSubHubbub protocol.

→ Learn more

blog comments powered by Disqus