11/9/09

The Predictioneer's Game: Using the Logic of Brazen Self-Interest to See and Shape the Future



Brilliant and intensely irritating3
This review has been edited to correct some misstatements pointed out by the author. I was working from a prepublication version that did not have all the end-notes, nor a reference to the website. Moreover, the author's comment to this review adds some useful material. On the basis of that, I would raise my rating from three stars to three and a half if that were allowed, but my basic opinion has not changed.

This book is likely to teach you some fascinating and useful material, but I can't recommend it wholeheartedly because it may drive you crazy as well. The basic idea is simple. Experts know a lot, but are bad at making predictions about human affairs. Simple models based on quantitative game theory are more accurate, and even when they're incorrect they expand your thinking in useful ways. Moreover, these models allow you to simulate alternatives and generate outcomes as good or better than the best human strategists can achieve.

To evaluate this book, it's useful to separate that claim into two parts. I'm a quant, and therefore I think it's pretty well established that you make better decisions by asking experts what they know and letting a computer trace the logical implications than by following the experts' recommendations. I also accept that simple quantitative models do remarkably good jobs, and are only rarely surpassed by complex qualitative analysis. Anyway, if you don't accept those positions, there's no point in even opening this book. So to me and probably to you if you're still reading, asking experts simple questions with answers on a scale from 0 to 100 and combining the results in a reasonable way, is an excellent approach to most decisions. Call this the basic quant position.

The author goes further than the basic quant position in three respects. First, he makes much stronger claims for the superiority of his approach. Second, he advocates specific game theory analysis that involves complex modeling, as opposed to simple rules such as guessing that the outcome will be somewhere near the average opinion weighted by salience and power. He doesn't justify his methods as practical shortcuts that seem to work, he repeatedly claims that they are backed by science and logic, unlike alternatives. Finally, he goes beyond prediction to use his model to engineer outcomes. This is quant-on-steroids. It made me recall that John Nash, the most important game theorist with respect to this kind of work, maintained he was Emperor of Antarctica.

To paraphrase Dizzy Dean, it ain't megalomania if you can back it up. This is where it starts to get irritating. In the preface, before you get to page 1, he writes, "I've been predicting future events for three decades, often in print before the fact, and mostly getting them right. . . . I have made hundreds, even thousands, of predictions--a great many of them in print, ready to be scrutinized by any naysayer." This guy makes extraordinarily bold claims about his quantitative prediction ability, and he doesn't keep track of his record? He can't even recall within a factor of ten how many predictions he has made? Who decided he was "mostly right?" And why is anyone who wants to know the record a "naysayer?" Even if you did all the work, unearthed all the printed predictions (he only references a few in the book) and found he was zero for 200, he could just say he got thousands of other ones right, ones you didn't find. This sounds more like a Nostradamus defender than the "science" he's always claiming.

To bookend that frustration, by the end of the book, despite frequent promises, he has not revealed his model! He does have a version on-line that allows you to play around with it, and has more details on how it works, but still no clear, top-down description. In the book, you get hints and bits and pieces, but no clear explanation of how he arrives at his predictions. And this is not the only broken promise, there are frequent comments that he will "go into this further" or "provide more details," later; I can't find one example where he follows through. On the other hand, there are a few facts that get repeated far too many times.

Those two things would be enough for a lot of people to conclude he's a fraud. But there's an awful lot of good, clear, insightful analysis in between. He gives examples of political and diplomatic predictions he has made, discussing the inputs and basic form of the analysis. There are accounts of corporate and legal struggles where he maneuvered to an outcome favorable to his clients. He also applies the methods to history, to ask what might have happened. This is all fascinating stuff, and the data and conclusions speak for themselves. They show plausibly that this approach could work, it is practical to implement and it leads to conclusions that are surprising, but can shown to be logical. Without a lot more details these stories don't prove the model works, but they represent a coherent claim that it does.

However, this brings us to another problem. Some of the accounts are not credible. An account of how he maneuvered a fifth-choice candidate into a CEO job requires us to believe the board of directors split into five groups of three that agreed among themselves on the exact preference order for the five candidates, that these generated a cyclic preference order that included all five candidates (a mathematically possible but unlikely result only previously observed in game theory textbooks), that all this information was known with certainty beforehand and that none of the board members was smart enough to consider coalition-building or voting a second choice when it was clear a first choice vote would be wasted. Moreover, the Rube Goldberg scheme that worked seems far less promising than simple politicking to either build a coalition or change a slight preference.

This is the least credible account (unless you include the million dollars he was offered by Libya to engineer the removal of Anwar Sadat from power in Egypt, or the 10% of Zaire dictator Mobutu's external wealth offered to keep him in power), but none of the stories include basic information to allow fact-checking. In some cases the need for confidentiality is clear, but why no names of the government officials who hired him, or the partners at Arthur Andersen? Why is he protecting the agents of Libya and Mobutu? Does the brokerage firm that bought his advice in 1992 still insist on remaining anonymous? (And does it even still exist?) Some discretion is understandable, but this book reminds me of the fictional spies who have all labels removed from their clothing and possessions.

The final irritation is only one account of a missed prediction is given, and it is explained implausibly. The author predicted Hillary Clinton's healthcare plan would pass in 1994. He claims that the outcome was changed by the Rostenkowski scandal. That's hard to believe, since Rostenkowski resigned from his leadership position before the first bill came to Congress. Rostenkowski was not a strong supporter of healthcare reform. There's no doubt that his political skills would have been useful, had he chosen to push the plan, and the scandal did weaken the Democrats in general, but many other things happened that seemed to be at least as important. So either the prediction was dependent on lots of unpredictable events, and therefore should have been given as a probability distribution instead of a point estimate, or Rostenkowski was special, in which case the prediction should have been healthcare will pass or fail based on how Rostenkowski does. And why was the prediction not updated as the scandal worsened?

I know this is a long review, but I've only covered some of the bigger irritations. If you're an easy-going, tolerant sort who wants to learn some important practical and theoretical aspects of prediction, by all means read this book. If not, you might want a blood pressure check before you attempt it.

Interesting game theory in operation primer3
Predictioneer is a very well written book. Game theory is introduced and developed in an understandable discussion of root problem identification, quantifiable stakeholder assignment and the mathematical process to derive an objective prediction input to the decision making process. Interesting contemporary problems are discussed. The reader will understand the `why' of game theory algorithms but not the `how' beyond the most basic and simplistic examples. Like all mathematical models, the devil is in the details and we don't get a peek at what's in the box.

Positives:

Good primer to operational game theory

Good tips on the methods and considerations for identifying and quantifying stakeholder blocs, stakeholding individuals and their ability to influence the outcome, salience or self interest and positional authority.

Interesting storytelling and contexts of game theory in operation.

Negatives:

I couldn't avoid feeling that the book is an advertisement for the author's services in a number of places.

The game theory example of `why Sparta fell so quickly' was a good example of how game theory inherently includes the subjectivity and information of the model's driver. This game theory post mortem failed to consider the uniquely effective contribution of Epaminondas revolutionary strategy of `total war'. Sparta disappeared from history but not for the game theorized reasons. GI/GO lives!

Game theory application still has a long way to go to be the decision engine of choice but I could be wrong ;)

More about the predictor than the prediction process3
The Predictoneer's Game is a story about the author and the accuracy of his predictions than a discussion on the application of Game Theory to decision making. While the book contains descriptions of Game Theory, the majority of its pages are dedicated to the author explaining past predictions and how they were destined to be accurate. If you are looking for a book on how to understand and apply game theory for yourself, then you will need to look elsewhere in my opinion.

In many ways, Bruce Bueno De Mesquita's book is similar to those written by Nicholas Taleb. Both authors explain their thoughts and tools in a self-referential style that you will notice throughout the book. In more than one place, this tone can be a bit overbearing. This is more of a book for those that admire game theory rather than people who want to learn how to apply game theory. This does not mean that the book is not enjoyable and worth the read - it is just not what I expected.

The Predictioneer's Game is organized around the authors experience applying game theory to a wide range of situations from peace in the Middle East, North Korea nuclear disarmament to how to purchase an automobile. Each of these case stories is interesting examination of the events and the motivations leading to the actor's decisions.

The book does describe approaches for applying game theory. The appendix contains sample calculations all of which will get people started. These will help get people started in applying game theory to understand the behaviors and motivations of players in a decision, but according to the author there is more to the model than a table of influence, salience and position figures. As an example of this limited support, the author talks about weaknesses in the model, errors you should avoid, but it provides limited examples of how to fix it.

It is an interesting, but challenging read. This book requires a quiet room where you can concentrate on reading and understanding the game theory ideas by reading between the lines.

The stories and case studies are interesting and make this book worth the read. However, I had expected more from one of the founding minds and leading practitioners of game theory. So it's a good book, more from the perspective of reading about the forces behind current and past events than identifying tools that the reader can use to make their own predictions.

About The Predictioneer's Game: Using the Logic of Brazen Self-Interest to See and Shape the Future detail

  • Amazon Sales Rank: #133 in Books
  • Published on: 2009-09-29
  • Released on: 2009-09-29
  • Original language: English
  • Number of items: 1
  • Binding: Hardcover
  • 272 pages

Features

The Predictioneer's Game: Using the Logic of Brazen Self-Interest to See and Shape the Future Description

Bruce Bueno de Mesquita is a master of game theory, which is a fancy label for a simple idea: People compete, and they always do what they think is in their own best interest. Bueno de Mesquita uses game theory and its insights into human behavior to predict and even engineer political, financial, and personal events. His forecasts, which have been employed by everyone from the CIA to major business firms, have an amazing 90 percent accuracy rate, and in this dazzling and revelatory book he shares his startling methods and lets you play along in a range of high-stakes negotiations and conflicts.

Revealing the origins of game theory and the advances made by John Nash, the Nobel Prize—winning scientist perhaps best known from A Beautiful Mind, Bueno de Mesquita details the controversial and cold-eyed system of calculation that he has since created, one that allows individuals to think strategically about what their opponents want, how much they want it, and how they might react to every move. From there, Bueno de Mesquita games such events as the North Korean disarmament talks and the Middle East peace process and recalls, among other cases, how he correctly predicted which corporate clients of the Arthur Andersen accounting firm were most likely engaged in fraudulent activity (hint: one of them started with an E). And looking as ever to the future, Bueno de Mesquita also demonstrates how game theory can provide successful strategies to combat both global warming (instead of relying on empty regulations, make nations compete in technology) and terror (figure out exactly how much U.S. aid will make Pakistan fight the Taliban).

But as Bueno de Mesquita shows, game theory isn’t just for saving the world. It can help you in your own life, whether you want to succeed in a lawsuit (lawyers argue too much the merits of the case and question too little the motives of their opponents), elect the CEO of your company (change the system of voting on your board to be more advantageous to your candidate), or even buy a car (start by knowing exactly what you want, call every dealer in a fifty-mile radius, and negotiate only over the phone).

Savvy, provocative, and shockingly effective, The Predictioneer’s Game will change how you understand the world and manage your future. Life’s a game, and how you play is whether you win or lose.


From the Hardcover edition.