Five Reasons the Prediction Market Critics Are Wrong.

No Gravatar

1. It really was an upset – As it has been pointed out elsewhere, the Clinton victory was a surprise to everyone. Favorites can lose. But so what? Ordinarily, that’s not a market flaw or a reason to doubt the odds shown in the market.

Justin Wolfers article in the WSJ had the best summary:

Against this background, it is no exaggeration to term the result truly historic. Not that there haven&#8217-t been more dramatic upsets or come-from-behind wins that carried more significance &#8212- this was just an early primary, albeit a pivotal one. But in terms of unpredictability, or at least the failure of everyone to predict it, it may have no modern match.

Historical comparisons are already being drawn between the New Hampshire primary and the famous 1948 presidential race…Yet the magnitude of the Clinton surprise is arguably even greater&#8230-Thus, Sen. Clinton&#8217-s victory on Tuesday was more surprising than President Truman&#8217-s in 1948.

Given the above, were the Clinton prices on Intrade very far off? It&#8217-s not obvious that they were.

2. Pundits/Critics are NOT traders – If I believe a contract should be trading around 30 and I see it trading at 7, it would make my day. As a trader, seeing a contract that is clearly mispriced is a good thing. Traders who remember the French politician Le Pen’s strong showing in 2002 vs his polls or who read Steve Sailer’s blog should not be surprised that people are dishonest with pollsters. However, to a pundit, an isolated incident of mispricing means the entire concept of prediction markets is faulty.

Since NH results, pundits have been asking, “Are prediction markets flawed?” The traders who make and move the market don’t believe so- they are trading more than ever. In any case, there were no postings on the 7th of January about how wrong the prediction markets are, only after-the-fact postings demonstrating perfect 20/20 hindsight. Traders, not critics, will determine the success of the prediction markets.

Let us not forget that pundits have an agenda too. For some, especially political ones, they need to present themselves as being able to offer insight that no one else has. Since prediction markets allow events to be quantified in real time, the pundits have less to add. This makes critics especially eager to take some of the shine off prediction markets and make themselves look smarter by comparison.

Additionally, there is a contingent of commentators and bloggers with an anti-market bias who delight in seeing any market based tool be wrong. They will be the first to loudly smear PM errors but no where to be found when the market turns out to be right.

3. PMs are not polls – This common mistake is exemplified by this quote from the Chicago Tribune, “The New Hampshire primary was a reminder that prediction markets, where bettors are putting money on the line, can have no more value than opinion polls, where participation costs nothing.” This critic missed the point and doesn&#8217-t realize he is comparing apples and oranges.

Most commentators have focused on the accuracy of the market prices without touching on the underlying purpose of the market: speculation and hedging. Even if the polls are no more accurate than the market, they still can’t be used for trading functions.

4. Regulations have hurt the accuracy and liquidity of PMs – The inconvenience of opening a trading account at Intrade has excluded many Americans from participating. What is the cost of accuracy to the PMs? Surowiecki’s The Wisdom of Crowds lists four factors necessary for a wise crowd: diversity of opinion, independence, decentralization, and aggregation. At least two of these have been highly restricted due to regulations. Even so, the market is usually more accurate than the polls. None of the critics has pointed out that with so many potential traders cut off from trading, the market is surely excluding informed participants.

5. “Serious people who study or work with these markets are not in the &#8216-markets are magic&#8217- camp” – Prediction markets are like other financial markets: fat tails, black swans, bubbles, “manipulations” etc. These are all visible in housing, equities, and fixed income markets as well and no one speculates about the end of those instruments. As Eric Zitzewitz pointed out, the “markets are magic” crowd is just a strawman and not a logical basis to attack prediction markets.

Digg Link:

http://digg.com/business_finance/Top_Five_Reasons&#8230-

Prediction markets = A tool for quantifying the conventional wisdom

No GravatarEric Zitzewitz responded to Paul Krugman:

Almost all of the serious people who study or work with these markets are not in the “markets are magic” camp.

My work in this area (with Justin Wolfers usually and Andrew Leigh and Erik Snowberg occassionally) uses these markets as a way of quantifying the conventional wisdom.

This has more value than may be immediately apparent. It can help you get from “the market rose 0.25% in response to Obama’s Iowa victory” to “the market rose 0.25% in response to Obama’s Iowa victory, which raised his nomination probability by 20% and did not affect the Democrats odds of winning in November” to an estimate of how much more stocks will be worth under Obama than Edwards or Clinton.

In corporate settings, a market can help turn something that “everyone knows” into an objective fact that can then be acted upon. The best example is probably markets on whether software projects will be completed on time– if a market run among the project team members says that the launch will be 2 months late, it becomes harder for the project manager to insist that everything is on track.

Eric Zitzewitz
Assoc. Prof. of Econ
Dartmouth College

Thanks to Jason Ruspini for the link. Jason also posted a comment on Paul Krugman&#8217-s post, and also on Felix Salmon&#8217-s post.

Previous blog posts by Chris F. Masse:

  • NUCLEAR SCANDAL: HubDub allow their traders to bet on celebrities’ death.
  • APRIL FOOL’S DAY: This year, again, CNET makes fun of the wisdom of crowds.
  • Play-money prediction exchange HubDub is a phenomenal success.
  • BetFair Australia’s spin doctor tells all about their payments to the horse race industry.
  • Meet Jeffrey Ma (at right on the photo), the ProTrade co-founder, and whose gambling life is the basis of the upcoming movie, 21.

VENERABLE LAW SCHOLAR CASS SUNSTEIN REBUTS PAUL KRUGMAN AND COMES OUT TO DEFEND THE PREDICTION MARKETS.

No GravatarCass Sunstein:

[&#8230-] Some people are now doubting not only the prediction markets but also the polls, saying that no one knows anything, and that anything is as likely as anything else. Don&#8217-t believe it. To be sure, we are continuing to obtain information about how prediction markets perform and when they do well and poorly. Perhaps they will turn out to be less reliable than they seem &#8212- and in all likelihood, we will obtain a better understanding of when they work. And of course no one has a crystal ball. But the polls are generally pretty good &#8212- and if you want to have a sense of the probabilities, you&#8217-d probably do best to consult Intrade.

Thanks to Stephen Bass for the link.

Previous blog posts by Chris F. Masse:

  • Red Herring’s list of the top 100 North-American high-tech startups includes Inkling Markets —but not NewsFutures, Consensus Point, or Xpree.
  • Professor Koleman Strumpf explains the prediction markets to the countryland people.
  • Professor Koleman Strumpf tells CNN that a prediction market, by essence, can’t predict an upset.
  • Time magazine interview the 2 BetFair-Tradefair co-founders, and not a single time do they pronounce the magic words, “prediction markets”.
  • One Deep Throat told me that this VC firm might have been connected with the Irish prediction exchange, at inception.
  • BetFair Rapid = BetFair’s standalone, local, PC-based, order-entry software for prediction markets
  • Michael Moore tells the Democratic people to go Barack Obama in Pennsylvania (a two-tier state), but the polls and the prediction markets tell us that that won’t do the trick.

HUBDUB = where the news shape the future

I like the motto dreamed up by Nigel Eccles and his Scottish team. [I think they&#8217-ll come up with a play-money prediction exchange, but I&#8217-m not sure exactly what they are doing up there.]

And he, too, has come up to the defense of the prediction markets.

[I have updated my list of PM friends. Quite a long list now.]


Author Profile&nbsp-Editor and Publisher of Midas Oracle .ORG .NET .COM &#8212- Chris Masse&#8217-s mugshot &#8212- Contact Chris Masse &#8212- Chris Masse&#8217-s LinkedIn profile &#8212- Chris Masse&#8217-s FaceBook profile &#8212- Chris Masse&#8217-s Google profile &#8212- Sophia-Antipolis, France, E.U. Read more from this author&#8230-


Read the previous blog posts by Chris. F. Masse:

  • Barack Obama is the 44th US president.
  • We already have prediction markets in future tax rates. It’s called the municipal bond yield curve.
  • DELEGATES AND SUPERDELEGATES ACCOUNTANCY
  • O’Reilly – Money-Tech Conference
  • Google Profiles
  • Event Derivative Exchange HedgeStreet is baaaaaaaaack… from the grave.
  • Sports Derivative Forum

The answer to any anti-prediction market backlash is quality, impartial, exchange-independent, science-based, diligent, pro-PM blogging.

No GravatarIs John Delaney the greatest psychic of all times (past, present, and future)?

Deep Throat is very impressed by how accurate the InTrade-TradeSports CEO&#8217-s 2005 prediction turned out to be. According to Deep Throat, the great Irish oracle &#8220-accurately predicted back in early 2005 in a PM conference in NY that someday the markets will make a horribly wrong prediction and that the [prediction market] industry will take a lot of s**t for it.&#8221-

Hummm&#8230-.

Deep Throat is easily impressed. What about the prediction below, then:

  • One of these days, a powerful hurricane will land in one of the southern states, and make billions of dollars in damage.

Vague and obvious predictions are of little help, here. An interesting thought to have, collectively, is how to prepare well in advance to counter such a backlash &#8212-as it is sure to happen again in the coming years. Due to the readers&#8217- new behavior (using the Web to get their info), the conversational aspect of the Web (comments, bloggers responding to their peers), and the velocity of the bloggers (tempests in tea cups spread over one or two days, and then the bloggers move on), the answer is quality, impartial, exchange-independent, science-based, diligent, pro-PM blogging.

You will note that InTrade-TradeSports, BetFair, NewsFutures, and the other PM firms, are completely absent from the dialogue between anti and pro PMs. The BetFair blog has not published anything about the New Hampshire fiasco, and the InTrade bulletin has only put in writing, on a post, the post-NH market-generated probabilities &#8212-without adding any bit of analysis. Totally pointless and useless corporate publications.

As for me, I have worked hard to put our group blog, Midas Oracle, on the blogging scene. I will further this endeavor and announce new initiatives in the future &#8212-if I am able to do so.

Previous blog posts by Chris F. Masse:

  • NUCLEAR SCANDAL: HubDub allow their traders to bet on celebrities’ death.
  • APRIL FOOL’S DAY: This year, again, CNET makes fun of the wisdom of crowds.
  • Play-money prediction exchange HubDub is a phenomenal success.
  • BetFair Australia’s spin doctor tells all about their payments to the horse race industry.
  • Meet Jeffrey Ma (at right on the photo), the ProTrade co-founder, and whose gambling life is the basis of the upcoming movie, 21.

Prediction markets are forecasting tools of convenience that feed on advanced indicators.

No Gravatar

Why were the political prediction markets so wrong about Barak Obama and Hillary Clinton in New Hampshire?

&#8230-asks Slate&#8217-s Daniel Gross &#8212-via Mister Usability (Alex Kirtland), who needs to go and get his own gravatar.

So, I&#8217-ve been watching the action in one of the political futures markets this evening, Intrade. And the action in this prediction market has reinforced my opinion that these are less futures markets than immediate-past markets. The price movement tends to respond to conventional wisdom and polling data- it doesn&#8217-t lead them.

Throughout the day and into the early evening, while polls were still open, Democratic investors, mimicking the post-Iowa c.w. and polls, believed Obama was highly likely to be the Democratic nominee. The Obama contract was trading in the lows 70s, meaning investors believed he had a 70 percent chance of being the nominee, while Hillary Clinton contracts were in the 20s. […] At 6 p.m., this market had written Hillary Clinton&#8217-s entire presidential campaign off. At 9:30 p.m., it was calling a dead heat. What caused investors to change their minds so drastically in the space of a couple of hours? A few data points that went against the day&#8217-s prevailing conventional wisdom and polls. […]

See also Niall O&#8217-Connor&#8217-s assessment:

I am looking forward to the post New Hampshire Caucus, when all you prediction market advocates crawl out from under your stones. For the record at one point the market on Intrade and Betfair was suggesting that Obama had a 95% probability of winning the caucas- whilst Intrade had him at 77% to win the nomination.A case perhaps of both the foolery of crowds and, the market biting back.

New Hampshire will go down as the Black Wednesday of prediction markets and unless there is now objective transparent debate (as opposed to the usual biased sabre rattling) – prediction markets will be dead in the water.

My answer to Dan Gross&#8217- legitimate question and to Niall O&#8217-Connor&#8217-s snarky comment:

  1. Prediction markets are forecasting tools of convenience that feed on advanced indicators. When those advanced indicators are wrong, the prediction markets are wrong.
  2. If you prefer the polls or the pundits, your call &#8212-but polls and pundits were also wrong, this time, right? Required reading for mister Niall O&#8217-Connor: &#8220-New Hampshire&#8217-s Polling Fiasco&#8221- + &#8220-Analysis: pundits eat crow&#8220-.
  3. The ultimate forecasting tool would be a way to reverse our psychological arrow of time &#8212-so as to remember the future instead of the past. Only science-fiction writers and some imbecile ( :-D ) believe in that.
  4. The prediction market approach is to stick with the markets, on the long term. Take their successes. Take their failures. Unlike Donald Luskin and Markos Moulitsas, Chris Masse will not turn against the prediction markets when they fail punctually. What counts is the long series.
  5. My first point should be included in the prediction markets approach definition, in my view, but others (like economist Michael Giberson) might have different opinions.
  6. With respect to my first point, I bet that the prediction markets will never replace the polls as the forecasting tool of choice for political analysts &#8212-on that particular point (but not on a myriad of others), I break away from Justin Wolfers&#8217- irrational exuberance and I side with Emile Servan-Schreiber of NewsFutures (my preferred play-money prediction exchange). Prediction market reporting will have a function, indeed (as suggests Justin Wolfers), but not the dominant function.
  7. Going forward, prediction market journalism should emphasize relative accuracy (as opposed to absolute accuracy) &#8212-that is, comparing prediction markets with polls and pundits, which is what Robin Hanson has said from day one. Our good friend Niall O&#8217-Connor has difficulty to compute that, apparently. He should eat more fish. :-D

&#8212-

Justin Wolfers:

In a few years, we may regard the second half of the 20th century as the aberration in which the press used polls rather than markets to track political races,” Justin Wolfers, a business professor at the University of Pennsylvania’s Wharton School, wrote in an e-mail message. “And in the 21st century, we may return to the habits of the early 20th century, reporting on political races through the lens of prediction markets rather than polls.

Emile Servan-Scheiber:

1) The traders themselves are the first to look at the polls to inform their trades. So the polls are here to stay.

2) Our recent experience in Western Europe seems to indicate that the superior accuracy of markets over polls when predicting elections may be a U.S. artifact that isn’t so easily reproducible elsewhere. I’ve discussed this with Forrest Nelson of IEM [Iowa Electronic Markets], and apparently, ever since the Truman-Dewey polling debacle of 1948, U.S. pollsters have adopted a policy of reporting mostly raw numbers rather than projections based on sophisticated secret formulas, so they can’t be accused of manipulating opinion. However, raw numbers are notoriously unreliable when based on small samples, and Western European pollsters never report them, preferring instead to publish projections based on historically-informed statistical formulas. What we’ve observed in France and Holland is that it it’s very hard to beat the accuracy of such projections.

[I don’t make mine Emile Servan-Schreiber’s second point, but that’s a minor.]

&#8212-

InTrade&#8217-s expired prediction markets:

&#8212-

New Hampshire

&#8212-

The Democrats

&#8212-

The Hillary Clinton event derivative was expired to 100.

Dem NH Clinton

Dem NH Obama

Dem NH Edwards

&#8212-

The Republicans

&#8212-

The John McCain event derivative was expired to 100.

Rep NH McCain

Rep NH Romney

Rep NH Huckabee

Rep NH Giuliani

&#8212-

Iowa

&#8212-

The Democrats.

The Barack Obama event derivative was expired to 100.

Dem Iowa Obama

Dem Iowa Clinton

Dem Iowa Edwards

&#8212-

The Republicans

The Mike Huckabee event derivative was expired to 100.

Rep Iowa Huckabee

Rep Iowa omney

Rep Iowa McCain

&#8212-

Source: InTrade

&#8212-

[A more complete prediction market reporting should have included expired contracts from NewsFutures and BetFair. Sorry for that. Note that InTrade-TradeSports is the only exchange to offer a “closed contacts” section.]

&#8212-

NEXT: Prediction Markets 101 + Who did best in explaining the prediction markets to the lynching crowd? + After the New Hampshire fiasco, 16 people came to defend the prediction markets, so far. + The prediction markets deserve a fair trial. + Prediction Markets = the greatest time-saving invention of this century

&#8212-

Felix Salmon slams Wall Street Journals Justin Wolfers -but not Chris Masse.

No Gravatar

Felix Salmon:

[…] And thirdly, if you&#8217-re Justin Wolfers, it&#8217-s probably smart not to make unhedged statements saying that Barack Obama has &#8220-better than a nine-in-ten chance of winning&#8221- the New Hampshire primary. […]

Previously: Prediction markets are forecasting tools of convenience that feed on advanced indicators.

The prediction markets reflect the polls and the national media.

No GravatarJason Ruspini:

In general, futures markets are &#8220-less futures markets than immediate-past markets&#8221-.

It is hard to evaluate the markets fairly given how difficult it is for someone in New Hampshire to participate in them. Naturally then, the [prediction] markets more easily come to reflect the polls and national media – which were wrong in this case. (Here, the left-leaning media fell in love with Obama, while the right-leaning media happily went about trying to bury the Clinton &#8220-dynasty&#8221-. Consider the tremendously misleading FOX NEWS clip that PoliticalBetting.com linked to over the weekend.)

The legal situation also damages liquidity to the point where these markets are usually manipulated at the margin, as traders with momentum sense a rout and begin to engage in predatory trading, i.e. pushing prices to extremes to force capitulation and/or margin blow-ups.

Dr. Servan-Shrieber&#8217-s comment suggests that these market errors might persist even in modern regulatory regimes like Holland, and corroborates the excellent Erikson/Wlezien paper. Leaving aside the question of significance, Erikson and Wlezien have apparently found a market inefficiency, but since markets can take this into account (they are a &#8220-meta forecasting tool&#8220-), we should expect it to dissipate over time.

Read the previous blog posts by Chris F. Masse:

  • Bzzzzzzzzz…
  • Bzzzzzzzzz…
  • “No offense, but I think Radley Balko is the most valuable blogger in America right now.”
  • Are you a better predictor than John McCain?
  • What does climate scientist James Annan think of InTrade’s global warming prediction markets?
  • Inkling Markets, one year later
  • One trader’s view on BetFair’s new bet-matching logic

The prediction markets deserve a fair trial.

No Gravatar

Niall O&#8217-Connor:

Sadly, from our analysis, the impression that one gets is of a market that is spooked by poll results– driven by stale news- and heavily influenced by gossip and rumour.

Questions:

  1. Could Lord O&#8217-Connor cite the name of a more accurate forecasting tool?
  2. Could Lord O&#8217-Connor publish his own track record at predicting the US and British elections?
  3. Could Lord O&#8217-Connor give one example of an infallible human institution?
  4. Could Lord O&#8217-Connor state publicly whether he believes in knowing the future in advance with 100% accuracy? (If yes, then I&#8217-ll suggest to the CIA to hire him to get Bin Laden.)

Previously: Prediction markets are forecasting tools of convenience that feed on advanced indicators.

Care to revise your statement, sir?

No GravatarJustin Wolfers:

In a few years, we may regard the second half of the 20th century as the aberration in which the press used polls rather than markets to track political races,” Justin Wolfers, a business professor at the University of Pennsylvania’s Wharton School, wrote in an e-mail message. “And in the 21st century, we may return to the habits of the early 20th century, reporting on political races through the lens of prediction markets rather than polls.

MP3 file

Previously: Prediction markets are forecasting tools of convenience that feed on advanced indicators.

Read the previous blog posts by Chris F. Masse:

  • Bzzzzzzzzz…
  • Bzzzzzzzzz…
  • “No offense, but I think Radley Balko is the most valuable blogger in America right now.”
  • Are you a better predictor than John McCain?
  • What does climate scientist James Annan think of InTrade’s global warming prediction markets?
  • Inkling Markets, one year later
  • One trader’s view on BetFair’s new bet-matching logic