By the time that the publishing industries spun up in Venice in the early- to mid-1500s, the ability to have access to more reading material than you could finish in a lifetime is now starting to become a general problem of the educated classes. And by the 1800s, it’s a general problem of the middle class. So there is no such thing as information overload, there’s only filter failure, right? Which is to say the normal case of modern life is information overload for all educated members of society.
If you took the contents of an average Barnes and Noble, and you dumped it into the streets and said to someone, “You know what’s in there? There’s some works of Auden in there, there’s some Plato in there. Wade on in and you’ll find what you like.” And if you wade on in, you know what you’d get? You’d get Chicken Soup for the Soul. Or, you’d get Love’s Tender Fear. You’d get all this junk. The reason we think that there’s not an information overload problem in a Barnes and Noble or a library is that we’re actually used to the cataloging system. On the Web, we’re just not used to the filters yet, and so it seems like “Oh, there’s so much more information.” But, in fact, from the 1500s on, that’s been the normal case.
So, the real question is, how do we design filters that let us find our way through this particular abundance of information? And, you know, my answer to that question has been: the only group that can catalog everything is everybody. One of the reasons you see this enormous move towards social filters, as with Digg, as with del.icio.us, as with Google Reader, in a way, is simply that the scale of the problem has exceeded what professional catalogers can do. But, you know, you never hear twenty-year-olds talking about information overload because they understand the filters they’re given. You only hear, you know, forty- and fifty-year-olds taking about it, sixty-year-olds talking about because we grew up in the world of card catalogs and TV Guide. And now, all the filters we’re used to are broken and we’d like to blame it on the environment instead of admitting that we’re just, you know, we just don’t understand what’s going on.
Yes! I think Google’s success, in part, is that it has been in the lead when it comes to effective and intuitive information filtering. Think about where it started, with the search algorithm – that’s all it was.
Though I do disagree with Shirky in thinking that the only way information can be catalogued is socially. I think there will be some ways in which and some things that can only be catalogued by people, but for the most part, algorithms and other automated process will be able to handle it. They’ll have to.