Distributed thinking vs distributed computing
Problems with a project that went live the day before meant I only got to see one talk at last weekend’s Over the Air in Bletchley - Francois Grey’s closing keynote on Citizen Science and Open Science. He’s an excellent speaker and the subject, about getting the wider population involved in science, was really interesting.
Francois spent some time talking about how effective projects that utilise distributed computing have been at promoting the public understanding of science. Apparently, a while ago CERN called up the guy at Berkeley who made SETI@home and asked him for help. From there, Francois’ team went on to support a bunch of research projects that put distributed computing at their core, gathering or processing valuable data from thousands of participants all while getting publicity and informing people of the subject in the process.
This made me think though. In my day job at FT Labs the kind of research - yes, it’s research, because web developers also try to solve problems scientifically, after all - I do relies more on something akin to distributed thinking than it does on distributed computing. Stackoverflow.com is really just a very efficient source of and platform for distributed thinking. The #lazyweb hashtag on Twitter is a switch that we toggle when we want to ‘turn on’ the distributed thinking functionality built into our online social network.
I’ve always thought that the Internet is great because it allows us to take the problem-solving algorithms that we’ve always followed in analog life and accelerate them enormously. Pre-Web, the scope for answers to our problems was restricted to our real-life social circle. As a computer scientist, I would have had to wander the conference circuit for years before I bumped into someone who’d been thinking about the same problem and arrived at the answer. Never mind having to describe the same problem over and over to people I meet.
Stackoverflow takes that process and speeds it up, applying some other algorithms for sorting answers.
So I began wondering why, if it’s so important and we’re so dependent on it, distributed thinking isn’t studied as a science in itself. Sure, Stackoverflow and online forums are great, but can’t we make an active effort to produce even more efficient platforms for distributed thinking?
Aren’t there other fields that could benefit from distributed thinking in the same way that computer engineers have benefited from it?
One example I found for a project that comes kind of close to this is the Polymath Project, which I discovered following a mention on Francois’ own blog:
In his recent and eminently readable book Reinventing Discovery, physicist and open science advocate Michael Nielsen makes a good case for ‘a new era of networked science’, as the book is subtitled. His first example is of a blogger and mathematician, Tim Gowers, and the progress he made on solving a tough mathematical problem thanks to blogging about it, and getting a lot of other mathematicians – pros and amateurs – involved that way. Gowers called this blog-based experiment the Polymath Project.
That’s a start, but I’d argue that blogging is probably the first iteration of a model for distributed thinking on the Web. Surely we can take it further than that?