The Predictions Of Experts

From Learning How to Think by Nicholas D. Kristof:

The predictions of experts were, on average, only a tiny bit better than random guesses — the equivalent of a chimpanzee throwing darts at a board.

“It made virtually no difference whether participants had doctorates, whether they were economists, political scientists, journalists or historians, whether they had policy experience or access to classified information, or whether they had logged many or few years of experience,” Mr. Tetlock wrote.

Indeed, the only consistent predictor was fame — and it was an inverse relationship. The more famous experts did worse than unknown ones. That had to do with a fault in the media. Talent bookers for television shows and reporters tended to call up experts who provided strong, coherent points of view, who saw things in blacks and whites. People who shouted — like, yes, Jim Cramer!

Mr. Tetlock called experts such as these the “hedgehogs,” after a famous distinction by the late Sir Isaiah Berlin (my favorite philosopher) between hedgehogs and foxes. Hedgehogs tend to have a focused worldview, an ideological leaning, strong convictions; foxes are more cautious, more centrist, more likely to adjust their views, more pragmatic, more prone to self-doubt, more inclined to see complexity and nuance. And it turns out that while foxes don’t give great sound-bites, they are far more likely to get things right.

This was the distinction that mattered most among the forecasters, not whether they had expertise. Over all, the foxes did significantly better, both in areas they knew well and in areas they didn’t.

Preconceived Beliefs

From Divided They Fall by Nicholas D. Kristof:

Another challenge is the biased way in which we gather information. We seek out information that reinforces our prejudices. One study presented listeners with static-filled recordings of speeches that they believed they were judging on persuasive power. Listeners could push a button to tweak the signal, reducing the static to make it easier to understand. When smokers heard a speech connecting tobacco with cancer, they didn’t try to improve the clarity to hear it more easily. But they pushed the button to get a clearer version of a speech saying that there was no link between smoking and cancer. Nonsmokers were the exact opposite.

This resistance to information that doesn’t mesh with our preconceived beliefs afflicts both liberals and conservatives, but a raft of studies shows that it is a particular problem with conservatives. For example, when voters receive mailings offering them free pamphlets on various political topics, liberals show some interest in getting conservative views. In contrast, conservatives seek only those pamphlets that echo their own views.

Likewise, liberal blogs overwhelmingly link to other liberal blogs or news sources. But with conservative blogs, the tendency is much more pronounced; it is almost a sealed universe.