Beware of Experts Bearing Predictions

Sign in

Become a MarketWatch member today

The Guru's Corner

May 26, 2011, 2:27 p.m. EDT

By Richard Moroney, Dow Theory Forecasts

CHICAGO (MarketWatch) "” For the investment adviser seeking publicity, the value of a bold and unequivocal prediction is tough to overstate. Promising a surefire winner set to double will get attention, as will predicting a drop in the Dow Jones Industrial Average /quotes/comstock/10w!i:dji/delayed DJIA +0.29%  below 1,000.

By comparison, recommending a diversified portfolio of stocks along with some cash as a hedge against market weakness may not attract much notice. After all, you don't need a diversified portfolio or a cash position if you know how events will unfold "” and many see no point in paying an adviser who can't see the future any better than they can.

Two flaws plague this line of reasoning. First, as baseball legend Yogi Berra said, "It is tough to make predictions, especially about the future." If your investment approach is based entirely on making predictions and betting on those specific outcomes, your returns will only be as good as your forecasts. History suggests that is a tough way to make a buck.

Second, the perceived certainty that a prediction can bring is not only illusory, it is also dangerous to your fiscal health. Once our minds latch on to a prediction, dislodging that conclusion can be difficult "” even in the face of subsequent contradictory information.

In one of the best-known investigations into the value of expert opinions, University of California psychologist Philip Tetlock solicited predictions from 284 professional economic and political forecasters, asking them to rate the probability of several potential outcomes.

Most of the questions had only three possible outcomes, writes Jonah Lehrer, author of 2009's "How We Decide." Yet the pundits picked the right answer less than one-third of the time. In other words, writes Lehrer, "A dart-throwing chimp would have beaten the vast majority of professionals."

What's more, Tetlock found that the most famous pundits tended to be the least accurate, consistently making overblown forecasts. Those with doctorates were no more accurate than those with only undergraduate degrees. Journalists were just as accurate as professors.

The problem, Tetlock concluded, was the certainty of the experts. Experts, especially prominent ones, were so confident in the accuracy of their particular world view that they imposed a "top-down solution on their decision-making process," writes Lehrer. Instead of weighing the evidence and trusting their gut, the experts disregarded evidence that contradicted their world view.

To be fair, we all tend to be overconfident, with a majority of survey respondents consistently answering they are above-average drivers. In dozens of experiments covering a wide range of professions and cultures, researchers have asked people to estimate a range of possible values for a number (such as the circumference of the earth) so that they have a 98% chance of being right. Instead of the 2% error rate one would expect if the respondents provided a sufficiently wide range, the error rate is typically between 15% and 30%.

WSJ's Alan Murray and Jon Hilsenrath discuss their impressions of working with CNBC anchor Mark Haines, who passed away Tuesday evening at age 65.

We all like a good story, much preferring a cause-and-effect explanation to a mere sequence of events. In "The Black Swan," Nassim Taleb explains our preference for narrative as an ingrained biological need; we want to see patterns and rules because our mind can better handle information that way. As a result, writes Taleb, our "inability to remember not the true sequence of events but a reconstructed one will make history appear in hindsight to be far more explainable than it actually was "” or is."

Finally, we all tend to underestimate the impact of outliers, the extreme events that few predict, like the sudden breakup of the Soviet Union or the Sept. 11 terror attacks. Particularly with investments, as Taleb rightly points out, what matters is not how often you are right, but how large your cumulative errors are. Even if you predicted the market flawlessly from year-end 2003 to September 2008, all your work would have been for naught if you failed to predict the sell-off that followed the failure of Lehman Brothers.

"GSO is up just 4.59% by Hulbert Financial Digest count vs. 18.24% for the total-return Wilshire 5000 http://bit.ly/jS07QW" 1:28 p.m. EDT, May 26, 2011 from MarketWatch

"G-8 gathered in France today to discuss the global economy and the political upheaval in North Africa & Middle East http://bit.ly/iEBLGP" 1:10 p.m. EDT, May 26, 2011 from MarketWatch

"The IPO world is divided into two groups: high-growth Internet stories and everything else. http://bit.ly/k1GSxG" 12:45 p.m. EDT, May 26, 2011 from MarketWatch

"Before your next roadtrip get plenty of rest, stay hydrated, maintain proper posture and stability, and stay focused http://bit.ly/mx6z40" 12:06 p.m. EDT, May 26, 2011 from MarketWatch

"Tampa Bay Lightning's are one win away from the Stanley Cup Finals. Here is a look at their story http://bit.ly/mr0KJE via @mwsportswatch" 11:31 a.m. EDT, May 26, 2011 from MarketWatch

Jennifer Openshaw

On Personal Finance

How to save a year of college costs

Peter Brimelow

Wall Street Irregulars

Veteran Allmon sees no crash ... just yet

Therese Poletti

Tech Tales

E-books: a seismic shift in publishing

Chuck Jaffe

Mutual Funds

Debit card changes swipe at consumers

Jeff Reeves

Strength in Numbers

5 ways outsiders can buy the next hot IPO

Jennifer Waters

Consumer Confidential

Drive like a race-car driver this summer

Kathleen Madigan

The Big Picture

Factories' breather will resonate in economy

Bill Mann

On Canada

Fighting in the oil sands box

Mark Hulbert

On the Markets

What the insiders are telling us about stocks

Al Lewis

Al's Emporium

Read Full Article »


Comment
Show comments Hide Comments


Related Articles

Market Overview
Search Stock Quotes