Common pitfalls of enterprise prediction markets: participants who lack relevant information, too few participants, and too little trading.

No Gravatar

GOAL:

&#8220-Prediction markets seek information aggregation from a large group of diverse individuals by encouraging active participation.&#8220-

REALITY CHECK:

&#8220-The biggest challenge is getting people in the company to be active&#8221- [].

InTrade CEO John Delaney refused to improve the fairness of the trading on his Ireland-based event derivative exchange.

No Gravatar

InTrade &#8212- US.GOVT.HEALTHPLAN.DEC09

truck-fail

One InTrade trader, in October 2009:

The four re-definitions that have (so far) been necessary during the 3-month life of the US.GOVT.HEALTHPLAN.DEC09 contracts have brought to my attention that Intrade, to the best of my knowledge, does nothing to notify members that contracts they own have been &#8220-clarified&#8221-. It may be coincidence that volume on this contract spiked upward on July 29, Septeber 5 &amp- 10, and October 9 following rule changes on July 28, September 4 &amp- 9 and October 9. I suspect, however, that some members were aware of the rule changes while others with open orders found out about them later. While avoiding such ambiguous contracts would be preferable, some system should be in place to ensure that the unexpected need to revise contract definitions does not provide certain members with an unintended advantage.

Among the possible changes that I feel would improve this situation are the following:
1) Post a notification in the &#8220-News&#8221- whenever existing contract definitions are changed.
2) Notify all members with current positions and/or orders in a given contract whenever rule changes are posted.
3) Halt trading for some period of time after each change to allow members equal opportunity to respond to these changes, rather than providing an advantage to anyone who might look back at the contract specs or read their email first, including anyone who might know to look for a change after requesting the clarification from Intrade.
4) Add an asterisk or other indicator beside the contract summary on the trading screen, so that members interested in that contract will know that the contract definition has been changed. Ideally, the date of this revision should be included.
5) Add whatever changes among the above are instituted to Rule 1.7.

Changes 1), 2) and 5) seem like common sense to me, but perhaps others will disagree. In any case, I look forward to other exchange members&#8217- comments on all of these suggestions.

The same trader, in December 2009:

Well, six weeks have passed since Mr. Delaney&#8217-s assurance that this issue would be addressed &#8220-ASAP&#8221-. Unless I have somehow missed being notified of the policy change , it seems clear that the status quo is fine by management.

All I can do to attempt to encourage Intrade to take seriously the ambiguities in certain contracts is:
1) liquidate all my positions in such contracts,
2) avoid trading any potentially ambiguous contracts,
3) attempt to warn other traders about contracts that may be potentially ambiguous.
In particular, I will certainly stay away from any contracts involving U.S. legislation.

I could instead try to anticipate specific improvements that would help minimize ambiguities. However, if Intrade management cannot be bothered to address this issue even in a broad way, I think that it would be counterproductive for me to apply the occasional Band-aid. Discouraging other traders from becoming entangled seems more productive.

Betting on Copenhagen

Emile Servan-Schreiber comments on a New York Times opinion piece:

The idea that betting could help us gain clarity on some controversial scientific questions has first been proposed by George Mason economics professor Robin Hanson in 1992 in a paper entitled &#8220-Could Gambling Save Science&#8221- and available online here: http://hanson.gmu.edu/gamble.html

The benefits of creating prediction markets about controversial climate-change issues in particular is further developed on Nate Silver&#8217-s blog and in this presentation given at CalTech in 2004: http://us.newsfutures.com/home/environmentalFutures.html

Feedback trading in prediction markets

No Gravatar

Robin Hanson is schooled about prediction market trading.

Our guest author to our Master Of All Universes:

Feedback trading just means the kind of momentum trading that is pervasive in traditional assets, again, less so in prediction markets. In the biastest experiment, traders were given formal &#8220-clues&#8221- about the settlement, but for many market participants, the best &#8220-clue&#8221- (even rationally, if lazy) is recent price action. Even if feedback trading was possible within the experiment, the outcome (manipulation attempts were corrected) suggests that it wasn&#8217-t prevalent.

In this experiment, traders were given equal endowments of shares/currency&#8230- i.e. initially had equal account sizes. Yes, there were an equal number of manipulators and non-manipulators, but they could not coordinate. Even if they were implicitly coordinating, this is not the same as a single large trader influencing the market. Yes, in the theory paper trading sizes were variable, but according to the same parameter for each trader. Maybe if there were a large supply of potential traders able to frictionlessly join the manipulated market, a manipulator&#8217-s relatively deep pockets wouldn&#8217-t matter.

The Robin Hanson manipulation papers make unrealistic assumptions, but its not like prediction markets are a bad idea…!!…

No Gravatar

In terms of unrealistic assumptions in Robin Hanson&#8217-s series of papers on manipulation, the major ones have been out there since at least 2004.

Despite some limited evidence, the insistence on traders needing to know the direction of manipulation isn&#8217-t too compelling since the direction will be manifest insofar as the price is &#8220-wrong.&#8221- &#8220-Noise trader&#8221- is a politically loaded and misleading term. Misleading because it suggests that the mean effect will be zero, when in reality &#8220-noise trading&#8221- usually takes the form of feedback trading. Lack of feedback trading is a significant assumption in the Hanson manipulation papers. Fortunately, prediction markets have objective settlements at specified times, unlike traditional assets where the meaning of prices is open to interpretation, making them more prone to feedback trading and irrational booms and busts.

With prediction markets, conditions for manipulation are more favorable when the settlement is far off in time, and when there are subjective inputs to the settlement, e.g. in politics. A distant settlement simultaneously makes it less clear what the real price should be, and delays manipulator losses because there is less incentive to correct price. At the limit, a manipulator could introduce a price distortion when a contract is launched, only to reverse position for small liquidity-related loss immediately before settlement, thereby destroying the markets &#8220-integral&#8221- of error over time.

Another big assumption, also identified by Paul Hewitt, is that traders have equal account sizes. But maybe this isn&#8217-t a huge problem if settlement is forthcoming, and maybe the issue could be mitigated with additional exchange disclosures, such as the standard deviation of position sizes in a given market. While this could discourage liquidity as large traders would become paranoid about their positions, it is essentially a &#8220-soft&#8221- position limit, and traders would be forewarned of one-sided markets (which could of course be the result of someone well-informed, but I &#8211- the google-anonymous* writer &#8211- would bet that more concentration comes with more error on average&#8230- this can be tested by someone with the data, of course maintaining trader anonymity)

Even accounting for long-term settlement, feedback trading, semi-subjective settlements, and account size imbalances, it seems one would have to abide to an overly rigid tenet of &#8220-do no harm&#8221- to hold that prediction markets are, on net, a bad idea. (Do no harm is of course abhorrent to libertarians, and even doctors don&#8217-t actually follow such a rule.) Moreover, some pathologies like political self-fulfilling prophecy will only happen if prediction markets have already demonstrated their value and have become more popular. But even if one believes in their long term success, single pathologies can damage one&#8217-s reputation permanently&#8230- if one plans to die at a reasonable age.

[*Given the political climate, many firms have issued directives to employees to not engage in even the slightest appearance of impropriety, which might include blogging on manipulation.]