My responses to a set of questions Chris Masse recently emailed to me:
Chris. F. Masse: Ken Kittlitz, you co-founded the Foresight Exchange (it went by the name “-Idea Futures”- at the time) in 1994. Would you mind telling me two words on your co-founders? Which ones brought the most into the project? Are you still in touch with them? Do you know what they have become?
Ken Kittlitz: David McFadzean got the ball rolling by bringing one of Robin Hanson’-s early prediction market papers to our weekly discussion group. Sean Morgan realized that the WWW, then still in its infancy, would be a great way to create such a market. Mark James, along with Sean, did most of the coding of the initial prototype. Duane Hewitt and myself did most of the work on a paper and presentation that our group presented at a conference the following year.
I’-m still in touch only with David- he’-s currently a software architect at QuIC, a company that creates financial risk analysis/mitigation products.
CFM: What was the spirit of your group at that time (in 1994). Did “-entrepreneurship”- mean something for you, guys? Did you envision a commercial venture, or was it just collegians’- play?
KK: Our weekly discussion group was known as the “-BS Group”- (Biological Simulation, in case you’-re wondering), so I’-d have to admit that “-collegians’- play”- is a fair summary. In 1995, we did try to turn it into a commercial venture, which quickly revealed our lack of business experience. We were all techies of one sort or another, and techies often struggle in the business realm.
CFM: Would you mind telling me two words on GMU professor Robin Hanson? How would you introduce him to some of our readers (I pity them) who have never heard of him?
KK: Robin’-s one of the smartest people I’-ve ever met and, unlike many smart people, not over-specialized. He has deep understanding of a number of fields: artificial intelligence, physics, economics and likely a few others I’-m not aware of. He has a habit of coming up with fascinating, controversial ideas, prediction markets being just one example.
CFM: You co-founded this play-money prediction exchange (Foresight Exchange) in 1994. In 1999/2000, Andrew Black and Edward Wray created and launched BetFair in England. BetFair became one of the most successful British start-ups and its two co-founders are now sitting pretty on a small fortune. In hindsight, don’-t you think that you should have moved to the U.K. and incorporated the Foresight Exchange there, using real money?
KK: In hindsight, I think that I should have done a massively-leveraged short sale of NASDAQ stocks in March, 2000.
The best way forward is always hard to identify, even with tools like prediction markets…-
When we tried to commercialize the original “-Idea Futures”-, starting a real-money market offshore was certainly something we considered —- though at that point, somewhere in the Caribbean seemed the likely venue. Even back then, it seemed likely that prediction markets would be considered a form of gambling, and hence subject to draconian restrictions. The Caribbean can be a nice place to live, but the prospect of never being able to return to North America to visit family and friends was quite a disincentive.
CFM: One thing that strikes me when visiting the Foresight Exchange is that you forbid sports prediction markets, which are very popular on the betting exchanges. Even Bo Cowgill’-s group of Googlers trade on sports, sometimes —-I believe. Sports trading can be fun. Are you a jock hater?
KK: Not really, but the Foresight Exchange was created primarily to focus on science and technology claims. Having it cluttered with a couple of dozen “-tonight’-s game”- claims per day wasn’-t too appealing.
CFM: If I can count, you have more than 12 years of experience in the field of prediction markets. You’-ve seen them all, in all colors and shapes. Do you agree with what Robin Hanson said at the Yahoo! Confab, namely that the DARPA’-s PAM scandal ignited interest in corporate prediction markets? Was the PAM scandal a “-tipping point”-?
KK: No. I think the real tipping point was the publication of James Surowiecki’-s “-The Wisdom of Crowds”-. Those of us interested in prediction markets tend to overestimate the PAM controversy’-s importance- it was a big deal for us, but only an incremental step in the general public’-s awareness of the topic. The interest generated by Surowiecki’-s book showed that prediction markets had “-arrived”- —- they weren’-t just of academic interest, but instead had real-world applicability.
CFM: Note that the DARPA’-s PAM prediction markets was to be public. Which leads to my next question. You and partner David Perry at Consensus Point help Fortune-500 companies setting up and running their own internal prediction markets. Have you ever had the case where one firm opened its corporate prediction markets to contractors and clients?
KK: Some of the firms we deal with are certainly interested in having a fairly wide audience, including customers and contractors, for their markets. I can’-t go into specifics at the moment, however.
CFM: How is Consensus Point doing, so far? Can you draw for us the portrait of the firm that wants to use internal prediction markets? Is it always to forecast sales? Do you sense that the requests come from senior executives or from mid-level prediction markets-enthusiast managers?
KK: Consensus Point is doing very well so far. A lot of inquiries do indeed originate from mid-level managers and researchers, but a fair number also come from the executive level. Sales forecasting is a popular application of the market, but project completion times and commodity price forecasting have also proved to be frequent questions.
CFM: Sorry to ask you this question bluntly. Would TradeSports and Betfair make great competitors of Consensus Point if ever they decided one day to sell prediction market services to organizations?
KK: Quite possibly, but it’-s certainly not a given. Both companies have great trading platforms, but their expertise is in running real-money, public markets. Corporations aren’-t really looking for that sort of domain knowledge when considering how to implement and use a prediction market.
CFM: Would you mind describing in a few words the prediction market services you sell? I guess it’-s web-hosted CDA, but are some firms interested in web-hosted MSR?
KK: We offer both hosted and on-site installations of our software, as well as training, analysis and consulting services. As for MSR versus CDA, see below.
CFM: Speaking of Market Scoring Rules, why did you decide to use this design as the engine for the Washington Stock Exchange? What is its main competitive advantage to CDA? How can MSR best be described: “-betting”- or “-simplified trading”-?
KK: The line between an MSR and a CDA is thinner than you might think! We have a market maker for each stock that provides liquidity by placing bid and ask orders- this is a convenient way of implementing an MSR within a CDA framework. An MSR really helps to start (and keep) the market going, because people always have a price they can buy or sell at. With an unadorned CDA, the bid/ask spread can be enormous, and trading volumes very thin. This alas, is often the case on the Foresight Exchange.
I’-d describe an MSR as allowing for “-simplified trading”- rather than “-betting”-, though I suppose it depends on how much thought the person interacting with it puts in!
CFM: Just curious. When a prediction exchange decides to use MSR, does it have to pay fees or royalties to its inventor, Robin Hanson?
KK: I don’-t believe so, but Robin is in a far better position to answer that question than I am…-
CFM: What is the biggest mistake (if any) you have made since the grand opening of Consensus Point? What did you learn from this big mistake?
KK: No really big mistakes come to mind. Of course, such things are often only obvious in retrospect, so ask me again in a few years.
CFM: What are corporate prediction markets competing against (if any)? Internal polls? Groups of in-house experts? The firm’-s executives? Something else?
KK: Generally, the firm’-s executives. We haven’-t encountered too many cases where firms have been trying to use internal polls as part of their forecasting efforts.
CFM: Are you positive that corporate prediction markets will show something for it? Will the economics literature soon be filled with business cases on how firms can clearly benefit from using internal prediction markets?
KK: Based on my experiences in the field thus far, I’-m confident that prediction markets will prove to compare favorably with the other forecasting methods companies use. This isn’-t to say that they’-ll always yield good information, or be the best thing to use in all situations, but I think they will turn out to be valuable.
Am I positive of this? Not absolutely. But then, I try not to be absolutely positive of anything!
CFM: Now, the question that kills. Tell me frankly. Are corporate prediction markets a “-fad”- or are they just started?
KK: Great question! I think it largely depends on how the prediction market community presents the ideas. There’-s a very real danger that the topic will be over-hyped and, consequently, ultimately dismissed, just as so many other trendy business ideas have been in the past. Today’-s darling is often tomorrow’-s pariah. That would be a shame, since (obviously) I think the markets have a lot of merit.
Note by “-prediction market community”-, I’-m referring not only to those who create and sell prediction markets and associated services, but also people who blog about the topic, create vortals, etc. Not mentioning any names here .
CFM: Are prediction markets just one forecasting tool, or do they have a bigger function, in your view?
KK: The pragmatist in me says they’-re just one tool, albeit a great one. The idealist finds something profoundly appealing in their ability to democratize how information is gathered and, ultimately, how decisions are made. The idealist thinks they’-re something more.
FYI, the basic MSR technology is in the public domain. There are things I know about advanced versions that I might charge for, but current applications do not need those.
I think it unlikely that Wisdom of Crowds would have been written without PAM.
“I think it unlikely that Wisdom of Crowds would have been written without PAM.”
PAM was in all the newspapers and magazines in July and August 2003 —and is still cited today in any recap on prediction markets.
http://hanson.gmu.edu/policyanalysismarket.html
http://hanson.gmu.edu/myPAMrole.html
http://hanson.gmu.edu/PAMpress.pdf
And I see that James Surowiecki published his book in 2004 —2005 is the year he promoted it, though:
http://www.randomhouse.com/features/wisdomofcrowds/meetauthor.html
Maybe:
PAM Press coverage + Wisdom of Crowds impact + TradeSports/Intrade Press coverage = the tipping point (2004–2005)
(((I’m no historian, though.)))
According to Amazon, “The Wisdom of Crowds” was published in May, 2004. It’s possible that Surowiecki started writing it after PAM broke the previous August, but given the typical lag time between when a manuscript draft is complete and when it is published, I think this a bit unlikely; i.e., my guess is that the draft was well underway by the time of PAM.
Surowiecki himself could probably settle this issue…
“Surowiecki started writing it after PAM broke the previous August”
Probably James Surowiecki had already thought and written about The Wisdom Of Crowds (at least partially), and the fact that the PAM scandal broke helped him market his book draft to publishers.
As Ken Kittlitz said, this is just an hypothesis and James Surowiecki would be the one to settle this minor issue.
Just to clarify: by the time the PAM story broke, almost all of The Wisdom of Crowds was written (I think I handed in the first draft in September or October 2003), and I had signed the contract for the book a couple of years before that. So the one didn’t lead to the other.
One interesting sidenote to the whole PAM discussion is that I actually wrote a column for The New Yorker in March of 2003 that talked about DARPA’s plans to use what I then called “decision markets” to improve intelligence forecasting, and the reaction to the idea both in-house and from readers was quite positive. That’s always made me think that what killed PAM was really the way it was spun by Wyden and Dorgan — and by the newspapers the next day — rather than any inherent flaw in the concept. (Although, to be fair, my column focused more on the idea of using prediction markets internally than on opening them to the public at large.)
Just my personal case:
– I was intrigued about prediction markets by some MSNBC.com coverage on PAM —end of July 2003, thus. I heard of the book, “The Wisdom Of The Crowds”, well after. (((I’m not implying that I’m the incarnation of the “tipping point”.)))
Jason Ruspini, when and how did you come into prediction market land?
Same question for the others, if they wish to take this non-scientific poll.
“any inherent flaw in the concept”:
– Just a remark, if I may. In my view, Robin Hanson (who was the guy in charge of the targeted area) made the mistake to focus on the Mid-East, an area of the world which the American traders have not the first clue about.
– I wonder what kind of information aggregation PAM would have gotten. Probably not much. A more secure choice would have been to target North America, but, as you know, there hasn’t been terrorist attacks within the U.S. since 9/11 —so there weren’t much to divine (we know that now).
– The fact that PAM was killed before its grand opening propelled this DARPA program into stardom (and Robin Hanson into martyrdom), but, just like with any other human projects, the first versions always reveal problems —that would have been the case for PAM, too.
The takeaway of the DARPA PAM program has been Robin Hanson’s Market Scoring Rules, which is a design many people tell me great things about. I’m in despair to see Robin Hanson spamming any PM conference he is invited in with his concept of decision markets (a market-generated automatism that nobody needs and, thus, nobody gives the first fig about) instead of educating the crowds about MSR.
There is great need to talk about MSR —both in a didactic way (for triple morons like me) and in a technical way (for PM-interested software architects and exchange managers).