Prediction Markets for Science?

No Gravatar

There&#8217-s a set of Robin Hanson slides that are much more interesting than the presentation he gave at Yahoo! Confab.

– It&#8217-s bigger (67 slides vs. 21) and it covers the prediction market problematic in a more comprehensive way (including MSR).

– The decision market concept takes a minor place, whereas at Confab, Robin Hanson made the mistake to focus most of his speech on it &#8212-interesting concept but that was the wrong audience (Confab attendees wanted specific answers about basic prediction market questions).

– Here are excerpts, but I recommend you to download the presentation file, read it from A to Z, and share it with your friends and colleagues. (And if you had downloaded his Confab slides, direction the trash can of your computer &#8211-don&#8217-t keep 7 megas of useless bits of information.)

&#8212-

Prediction Markets for Science? – (PPT) – by Robin Hanson – 2006-12-XX

&#8212-

Today’s Science Prices (Play $ Alas) – [Foresight Exchange]
11-14% P != NP proven by 2010
16-18% Cancer cured by 2010
16-19% Cold fusion works by 2015
28-29% Mammal immortality by 2015
28-31% Eventual universe collapse
68-70% Fusion energy sold by 2045
74-76% Extraterrestrial life by 2050
91-95% A gamma ray burst w/in 33Mly
93-95% Cosmo constant &gt- 0
93-96% Neutrino mass &gt- 0

Science Decision Markets
E[ Iraq civil war | US moves troops out? ]
E[ Sea levels | Raise CO2 tax ]
E[ Lifespan | Health care reform ]

E[ Murders | More gun control ]
E[ Cancer deaths | More research funding ]
E[ Firm stock price | fire CEO? ]
E[ Succeed? | Fund project ]
E[ Publications | Hire candidate ]
E[ Citations | Publish ]

Theory I – Old
“Strong Efficient Markets” is straw man

No info – Supply and Demand
Assume beliefs not respond to prices
Price is weighted average of beliefs
More influence: risk takers, rich
Info, Static – Rational Expectations
Price clears, but beliefs depend on price
No trade if not expect “noise traders”
Price not reveal all info
More influence: info holders

Theory II – Market Microstructure
Info, Dynamic – Game Theory

Example – Kyle ’85
X – Informed trader(s) – risk averse
Y – Noise trader – fool or liquidity pref
Market makers – no info, deep pockets
If many compete, Price = E[value|x+y]
Info markets – use risk-neutral limit
If Y larger, X larger to compensate more info gathered, so more accuracy!

Theory III – Behavioral Finance
Humans are overconfident

Far more speculative trade than need
Mere fact of disagreement shows
Overconfidence varies with person, experience, consequence severity
Implications
Price in part an ave of beliefs?
Adds noise to price aggregates?
Prices more honest than talk, polls, …

Ask the Right Questions
Cost independent of topic, but value not!
Seek high value to more accurate estimates!
Relevant standard: beat existing institutions
Where suspect more accuracy is possible
Suspect info is withheld, or not sure who has it
Prefer fun, easy to explain and judge
Prefer can let many know best estimates
Not fear reveal secrets, use fear to motivate
Avoid inducing foul play

Eight Design Issues
How avoid self-defeating prophecies?
How handle billions of possible combos?
What if terrorists lose $ to mislead us?
What if terrorists gain $ by give us info?
How not alarm public, inform terrorists?
Price can mislead if deciders know more.
Will markets induce people to lie?
Will markets help employees embezzle?

&#8212-

Thoughts About &#8220-Decision Markets&#8221-:

Decision Market for Science
&#8212-

#1. Robin Hanson first wanted to apply his decision market concept to refine the democratic process &#8212-&#8221-vote on values but bet on beliefs&#8220-. He calls that &#8220-futarchy&#8221- (PDF) &#8212-as far as I can see, only some libertarian wackos like Chris Hibbert or Peter McCluskey bought the idea. (I&#8217-m not even sure his paper was accepted somewhere for publication.)

#2. Now, Robin Hanson tries to plug his decision market concept as a management decision tool &#8212-here&#8217-s from his Confab presentation:

Decision Market Applications

E[ Revenue | Switch ad agency? ]
E[ Revenue | Raise price 10%? ]
E[ Project done date | Drop feature? ]
E[ Project done date | Add personnel? ]
E[ Stock price | Fire CEO? ]
E[ Stock price | Acquire firm X? ]

The guy doesn&#8217-t have the slightest chance that his envisioned applications see the ray of light, one day (that is, before his head gets chopped off and frozen, shortly after his death). Basically, he wants the senior executives to be replaced with a market-generated automatism. Even if he can prove that it would lead to lead to better management decisions (and I trust him on that), he&#8217-ll encounter entrenched resistance from the same people his decision tool was created to compete with. I&#8217-d short-sell Robin Hanson on that one &#8212-with all my might, and I&#8217-d bet George Soros would see an opportunity here.

#3. The only chance the guy has would be to dig the field of management science for areas where a series of micro decisions are taken by mid-level executives or technologist or scientists or other employees &#8212-but NEVER by senior executives. In that perspective, all the examples of applications he gave above are worthless &#8212-direction the trash can of your computer (and select &#8220-empty the trash can&#8221-, to make sure they disappear for good.)

#4. Robin Hanson (who is a bright inventor) is totally incapable of seeing the light of what could be a successful innovation. The only chance the guy has would be for him to network with Silicon Valley&#8217-s geeks-turned-IT-executives, and, after a series of of pitches, maybe he would get feedback from someone who can find a mutant idea &#8212-an idea that is original, almost bizarre- an idea nobody ever thought of before. Robin Hanson, on his own, is totally incapable of thinking creatively in terms of innovation &#8212-he likes big ideas but he doesn&#8217-t get people and marketing (including internet usability). Which is why I&#8217-m suggesting to him to go West and to find his complement(s) there. That&#8217-s his only chance.

Prediction Markets, Decision Markets, and More

No Gravatar

Prediction Markets, Decision Markets, and More – (PPT) – by Robin Hanson – 2006-12-13

– All speculation is “gambling”!

In direct compare, beats alternatives – (Vs. Public Opinion – Vs. Public Experts – Vs. Private Experts)

Advantages – (Numerically precise – Consistent across many issues – Frequently updated – Hard to manipulate – Need not say who how expert when – At least as accurate as alternatives)

&#8212-

What&#8217-s above is about &#8220-prediction markets&#8221-. Now, below, here are possible instances of &#8220-decision markets&#8221- (a more complex form of prediction markets, structured to be a decision tool, not jut a forecasting tool):

Decision Market Applications

E[ Revenue | Switch ad agency? ]
E[ Revenue | Raise price 10%? ]
E[ Project done date | Drop feature? ]
E[ Project done date | Add personnel? ]
E[ Stock price | Fire CEO? ]
E[ Stock price | Acquire firm X? ]

Libertarian baiting

No Gravatar

CFM hated it when Peter McCluskey wrote:

What many of us want from prediction markets bears more resemblance to the products of think-tanks than it does to any other institution that I&#8217-m aware of

But this reminds me of something. When has a pro-market think tank ever subjected its policy recommendations to market evaluation? Never, as far as I know.

The Independent Institute published a book chapter on Decision Markets by Robin Hanson in Entrepreneurial Economics. When institute Research Director Alexander Tabarrok gave a talk on the book, you can guess what subject he spent the most time on.

Think tanks that talk about prediction markets (AEI-Brookings is another) should walk the walk, as should institutions that laud the rigors of the market generally. This could involve setting up and running a non-profit exchange or paying Intrade to offer certain contracts, or variations between.

Many think tank proposals have virtually no chance of implementation. These would not be ideal candidates for prediction market evaluation, but not all think tank prescriptions are politically impossible, and much of what think tanks do is critique proposals that do stand real chance of implementation. If the choice is between yet another Op-Ed and a contract on the subject, I&#8217-ll take the latter.

I&#8217-ll make a $500 donation to the first think thank that makes an interesting, non-bogus use of real-money prediction markets before the end of 2007. I&#8217-ll be the judge of bogosity and interestingness, but I can say that a paper about prediction markets counts as uninteresting.

&#8230-

A grouping that loves to talk about markets (that is when they&#8217-re not going off on incoherent rants) but hates any sort of evaluation consists of U.S. Libertarian Party candidates, activists, and donorsfools. Each election there are LP candidates who vigorously argue that they have a good shot at winning significant office or at least obtaining millions of votes in the case of the U.S. Presidency, ignoring 35 years of abject failure.

The case of Michael Badnarik&#8217-s &#8220-campaign&#8221- for U.S. Congress ending last month is a hilarious case in point. He raised over $400,000, claimed he could win, and got &#8230- 4 percent of the vote. He&#8217-s now begging for another $200k and it turns out his &#8220-campaign&#8221- &#8220-manager&#8221- is starting his own Scientology-like religion.

That&#8217-s not all that out there for an LP campaign, nor is it surprising&#8211-there is no competition from non-wackos for candidacies that are doomed to failure.

One LP campaign this cycle that didn&#8217-t appear to be crazy but nevertheless radically overestimated its chances of success was that of Bob Smither, running in Tom DeLay&#8217-s GOP district against a Nick Lampson, a Democrat ex-Congressperson (who won easily) and a write-in Republican. Because the TX-22 race this year was unusual it was one of several seats Intrade ran markets on. The Intrade market included DEM, GOP, and FIELD contracts. FIELD could be taken as representing Smither, so this may have been the very first LP candidacy evaluated by traders. (FIELD exists in most Intrade election outcome markets but typically attacts no trading, as the field hasn&#8217-t a snowball&#8217-s chance in hell.) Their evaluation was not kind, as I pointed out in a blog post and several times in comments on a blog (no longer live) that hyped Smither&#8217-s chances, where I goaded fans to place bets. Smither polled 6%, against 51% for the Democrat and 43% for the write-in Republican.

One doesn&#8217-t need a prediction market to see that LPers are delusional, amnesiac, or just plain stupid. But as someone with strong libertarian sympathies (actually like prediction market legal scholar Tom W. Bell I&#8217-d prefer to take back the word liberal) I&#8217-ll gladly take additional opportunities to rub the facts in the face of my embarrassing and hypocritically scared-of-markets fellow travellers in the LP.

&#8230-

Did I say baiting? Oops, I meant betting!

Irankling Study Group

No Gravatar

Three years after the Policy Analysis Market proposal&#8217-s untimely and tragic abortion has analysis of probable policy consequences improved at all? If reports on the Iraq Study Group are any indication, the answer is no. I gather a group of commissioners and their staff chatted with a number of supposed experts over many months and eventually churned out a long list of plausible sounding recommendations with zero attempt to quantify probability or size of the consequences of those recommendations. The report itself, which I have only skimmed, contains 39 instances of the word could, 34 of the word would, one of the word prediction:

These and other predictions of dire consequences in Iraq and the region are by no means a certainty.

Awww, that&#8217-s nice. And one of the word probability:

But there are actions that the U.S. and Iraqi governments, working together, can and should take to increase the probability of avoiding disaster there, and increase the chance of success.

Note that the report isn&#8217-t assigning probability, rather asserting someone should take care to increase the probability of a good outcome!

The report&#8217-s analysis of four often advanced policy courses (Section I(C): withdrawal, stay the course, more troops, devolution) consists of a string of cheap assertions.

&#8230-

Unfortunately no private sector prediction market has stepped in to fill this vacuum.`A little over two weeks ago as speculation about the ISG and potential changes in U.S. policy ramped up I looked for prediction markets relevant to Iraq and found three, all play money, one at each of FX, Newsfutures, and WSX. Unfortunately all are concerned with U.S. troop levels or deaths and none are conditional on other events.

So I created a market on Inkling with four stocks: will the Iraq Body Count increase by 40,000 or more from May through December of 2007, conditioned on whether U.S. troop levels fell below 100,000 in April 2007.

The latter will be judged based on the outcome of the Newsfutures contract USLEAV07. It seemed to make some sense to condition on an existing contract which already had some history and volume. As far as I know this is the first time a contract on one prediction market site has been conditioned on the outcome of a contract on another site. Not that it matters. This market was not a rare jewel, but an utter failure.

The market has attracted a total of two traders have made two trades, leaving prices almost exactly at their starting points, while Newsfutures&#8217- USLEAV07 has fallen by over half. There&#8217-s nearly free Inkles for the taking. Actually there are many markets at Inkling offering nearly free Inkles, including two Democratic U.S. presidential nomination markets with sharply different prices for some candidates, but apparently nobody wants Inkles.

Links to Iraq-related markets referenced above are at my personal blog.

&#8230-

If I create a play money market again I shall do so on FX, which at least has a base of knowledgeable traders, some of whom are fairly motivated to improve their FX score. I make an exception for playing with new sites.

Like our host I would like to see more (any!) socially relevant real money prediction markets. Over a year ago Masse said the solution is always &#8216-better marketing&#8217-. Slightly less than a year ago he said The key to more socially relevant prediction markets is better marketing. Stay tuned, folks.

I&#8217-m not certain that marketing is the critical piece (Tradesports hasn&#8217-t really tried &#8220-if you build it, they will come&#8221- though this hasn&#8217-t entirely stopped academics from using prediction and other market prices and fortuitous circumstances to make some socially relevant inferences), but it couldn&#8217-t hurt when combined with a tiny bit of vision.

I&#8217-m staying tuned.

Previous blog posts by Mike Linksvayer:

  • Voodoo analysis of prediction market contracts
  • Bob Barr markets
  • Bob Barr candidacy fails market test.
  • Small comforts of prediction markets
  • The Economist is taking suggestions.
  • Long-term housing derivatives?
  • Economists to Watch

How to Define EU Failure for Betting Purposes?

No Gravatar

Scenarios for possible breakup of the European Union have been a lively discussion topic for years. So far the EU is holding together but the possibility of some kind of radical restructuring is always in the background. With the help of a couple of people who may wish to join this conversation, I hope to create prediction markets that produce reasonable probability estimates for various EU events including complete breakdown. These will not be real-money markets but I think they will be useful nonetheless. The purpose of this blog post is to solicit suggestions on how to frame EU breakup (i.e., which tradable propositions or bundle of tradable propositions should we make available to traders) and on the specific contract specifications to use in such prediction markets.

There are at least two difficult issues: 1) defining the time horizon (expiration date) for each contract and 2) defining the criteria for EU failure. Time horizon is tricky from a liquidity perspective, because the plausible failure scenarios all occur at least a couple of years from now- traders usually prefer shorter-term contracts. WRT the other issue, failure criteria, how would we define EU failure? Would it be:

– Germany/France formally withdraws by date X?

– Germany/France resumes use of its own currency by date X?

– X nations formally withdraw?

– Value of the Euro declines below some fraction of the USD?

– UK/other country does not adopt Euro currency by date X?

– Euro currency removed from circulation?

– Repeal of acquis communautaire?

– Formal end of the EU?

– Something else?

So we might have a series of contracts along the lines of, &#8220-German govt formally withdraws from EU by 31 Dec. 2010 [2011, 2012, 2013, . . .]&#8221-

Or we might have a range of contracts (German formal withdrawal, French formal withdrawal, UK non-adoption, etc.). IOW, instead of defining EU failure as a discrete event, we provide contracts on multiple scenarios and traders bet on whichever basket of scenarios they prefer. This approach makes more sense to me than would an attempt to define &#8220-EU failure&#8221- as a single event.

Based on suggestions I&#8217-ve already received, I think the following contracts might make sense:

Next country to drop out. There would be one such contract, with no expiration date, for each country. All contracts expire when one country drops out (expiration value would be 100 for that country and 0 for the other countries), and would be automatically recreated for the remaining countries. There would have to be a contract provision to handle simultaneous withdrawal by multiple countries, but that shouldn&#8217-t be difficult. And of course withdrawal must be defined precisely.

Country X adopts/rejects single currency by 31 Dec. 20XX. (Again, &#8220-adopts&#8221- or &#8220-rejects&#8221- must be defined.)

Germany/France + one other country are last remaining EU members on 31 Dec. 20XX. (&#8221-EU member&#8221- must be defined.)

Euro currency removed from circulation by 31 Dec. 20XX.

But the above contract ideas are merely first efforts.

How would you define EU failure for contract purposes? What kinds of contracts would you like to see? How to make such long-term contracts appealing to traders?

I much appreciate any suggestions. Thanks.

The HRC attack, part 2

No Gravatar

Rationalization of the HRC attack

Since it seems that I won&#8217-t secure any more capital on which to exploit this within the relevant timeframe, I thought I&#8217-d complete the circle regarding the HRC attack of several days ago. (For the first half of the analysis, please read this post.)

The attack was clearly &#8220-irrational&#8221- and not related to release of any public information&#8211-if not directly contrary to that day&#8217-s information. A buyer with the sophistication of knowing the publicity power of Tradesports stats, who had learned a key piece of inside information, would have bought Hillarys much more gradually, saving himself significant dollars. However, we already established that no piece of private information could realistically justify the movement from 54.5% to 68.5%. It seems clear that the attack was &#8220-irrational.&#8221- But if every event is caused by something, what would cause this attack?

My answer: someone internal to the &#8220-Run, HRC, run&#8221- decision process wants Hillary to run, and is searching for other factors with which to convince her that she will run. So that someone, my guess is a senior staffer with some money lying around, did this so that s/he could go to Hillary and, having gone over the latest poll numbers, say, &#8220-Oh, by the way, the market numbers [which are so impartial, of course] on your likelihood of getting the nomination are&#8230-&#8221- And 68.5% sounds a lot better than 54.5%. The staffer probably knew it would go down pretty quickly, but it did happen, so it&#8217-s not a lie, even though the meaning was totally deceptive. And as the attack occurred at about 6 AM Eastern, it would be just in time for the morning briefing! (Yeah, that might be trying to tease too much out of the inference. Who knows. Right?)

Hillary is reading the tea leaves, sees her high negatives, sees her perceived and actual huge baggage, and is feeling hesitant about the whole idea. The final go-ahead to her big donors will happen sometime in December. I am sure that someone is staking big bucks trying to convince her to run. Probably a senior staffer who has a ton to gain personally and career-wise, if Hillary goes all-out. And Hillary is a lot more skittish than 55% skittish.

Addendum, again from Hotline: FNC&#8217-s Cameron: &#8220-The chairman of Iowa&#8217-s Democratic party told Fox News that Mrs. Clinton has not been adequately laying the groundwork for her campaign and that first in the nation caucus goers are being told she may not run because of growing buzz over Illinois Freshman Senator Barack Obama&#8217-s expected candidacy.&#8221-

The plan was for Iowa Gov. Tom Vilsack to be the stalking-horse for the Iowa caucuses, and render it irrelevant. The Iowa primaries are about retail politicking, which Hillary hates. Unfortunately for Hillary, Vilsack&#8217-s polling has been dismal, even in his home state. Which renders his run all the more irrelevant, and irrational, without ulterior motives.

Recession Contract Proposal

No Gravatar

A few days ago, I came across Chris&#8217-s question concerning recession prediction:

My Question: How would you structure a US recession prediction market? (…without splitting liquidity, I mean.)

My initial response to this was:

A recession is defined as two consecutive declines in real GDP. Why not create a series of contracts, as follows:

US.RECESSION.4Q06.1Q07
US.RECESSION.1Q07.2Q07
US.RECESSION.2Q07.3Q07

Here are some more of the contract details:

The Expiry Price will be 100 if Real GDP declines for two consecutive quarters, and 0 if Real GDP does not decline for two consecutive quarters. Final Real GDP figures (3 months after quarter end) will be used, not the advance (one month after) or preliminary (two months after) Real GDP numbers.
The Result used to determine the expiry prices will be the official figures released by Bureau of Economic Analysis, an agency of the US Dept of Commerce.

Comments welcome and appreciated!

Prof. Bainbridge on Burton Malkiel on the efficient capital markets theory (ECMH)

No GravatarProf. Bainbridge on Burton Malkiel on the efficient capital markets theory (ECMH):

The second pillar of Malkiel&#8217-s analysis is the efficient capital markets theory (ECMH). The fundamental thesis of the ECMH is that, in an efficient market, current prices always and fully reflect all relevant information about the commodities being traded. In other words, in an efficient market, commodities are never overpriced or underpriced: the current price will be an accurate reflection of the market&#8217-s consensus as to the commodity&#8217-s value. Of course, there is no real world condition like this, but the securities markets are widely believed to be close to this ideal. There are three forms of ECMH, each of which has relevance for investors:

Weak form: All information concerning historical prices is fully reflected in the current price. Price changes in securities are serially independent or random. What do I mean by &#8220-random&#8221-? Suppose the company makes a major oil find. Do I mean that we can&#8217-t predict whether the stock will go up or down? No: obviously stock prices generally go up on good news and down on bad news. What randomness means is that investors can not profit by using past prices to predict future prices. If the Weak Form of the hypothesis is true, technical analysis (a/k/a charting)-the attempt to predict future prices by looking at the past history of stock prices-can not be a profitable trading strategy over time. And, indeed, empirical studies have demonstrated that securities prices do move randomly and, moreover, have shown that charting is not a long-term profitable trading strategy.

Semi-Strong Form: Current prices incorporate not only all historical information but also all current public information. As such, investors can not expect to profit from studying available information because the market will have already incorporated the information accurately into the price. As Malkiel demonstrates, this version of the ECMH also has been well established by empirical studies. Implication: if you spend time and effort studying stocks and companies, you are wasting your time. If you pay somebody to do it for you, you are wasting your money.

Strong Form
holds that prices incorporate all information, publicly available or not. This version must be (and is) false, or insider trading would not be profitable.

Previous blog posts by Chris F. Masse:

  • Is that HubDub’s Nigel Eccles on the bottom left of that UK WebMission pic?
  • Collective Error = Average Individual Error – Prediction Diversity
  • When gambling meets Wall Street — Proposal for a brand-new kind of finance-based lottery
  • The definitive proof that it’s presently impossible to practice prediction market journalism with BetFair.
  • The Absence of Teams In Production of Blog Journalism
  • Publish a comment on the BetFair forum, get arrested.
  • If I had to guess, I would say about 50 percent of the “name pros” you see on television on a regular basis have a negative net worth. Frightening, I know.

HUMAN market makers = LEAD market makers

No Gravatar&#8230- in the One Chicago&#8217-s lingo.

As opposed to &#8220-automated market markers&#8221-.

My Question: Does anybody know what is the correct / most popular terminology, here?

Addendum: JC Kommer has posted a comment&#8230-

Anybody can trade via “automated market marking”.

With its &#8220-Lead Market Maker&#8221- program, OneChicago sends a clear signal: there is nobody here and if you come you will get screwed because the &#8220-Lead Market Maker&#8221- has certain privileges such as priority in the order queue and lower fees.

Previous blog posts by Chris F. Masse:

  • Collective Error = Average Individual Error – Prediction Diversity
  • When gambling meets Wall Street — Proposal for a brand-new kind of finance-based lottery
  • The definitive proof that it’s presently impossible to practice prediction market journalism with BetFair.
  • The Absence of Teams In Production of Blog Journalism
  • Publish a comment on the BetFair forum, get arrested.
  • If I had to guess, I would say about 50 percent of the “name pros” you see on television on a regular basis have a negative net worth. Frightening, I know.
  • You can’t measure the usefulness of a system by how many resources it consumes.