Infinite Monkeys: The Limits of Probability Theory


No one could be more frank, more painstaking, more free from
subjective bias or parti pris than Professor Tinbergen. There is
no one, therefore, so far as human qualities go, whom it would be
safer to trust with black magic. That there is anyone I would
trust with it at the present stage or that this brand of statistical
alchemy is ripe to become a branch of science, I am not yet
persuaded. But Newton, Boyle and Locke all played with
alchemy. So let him continue.

— John Maynard Keynes speaking of one of the pioneers of econometrics

Recently the blogger Lord Keynes over at the always excellent Social Democracy for the 21st Century blog has been doing some posts about probability theory (examples here, here and here). There is a famous theorem in statistics called the ‘Infinite Monkey Theorem’ which states that as n approaches infinity the probability Xn approaches zero. We’ll get back to this theorem later but let me lay down a theorem of my own — one which I hope that Lord Keynes and others interested in this topic pay attention to: as a person’s wonderment at probability theory approaches infinity the probability that they will get anything of worth done approaches zero.

I say this because the issues surrounding probability theory and economic theory, while they are so profound as to be possibly the most important part of economic theory, are nevertheless a rather basic and simple metaphysical puzzle that can be laid out in clear terms and thus answered in clear terms. Once you understand this puzzle you “get it” and the deeper you dig into probability theory, the more this puzzle will repeat itself. Indeed, this puzzle has already been laid out and answered by the Post-Keynesian economist Paul Davidson in his writings on ergodicity in the social sciences.

Everything comes down to this: do you believe that the future mirrors the past? Or, put another way: do you believe in deterministic laws that govern the universe and can be understood by human beings? Everyone can answer that question themselves. It is a metaphysical question that borders on the theological — and it really goes all the way back to the debate between Erasmus and More on the existence of free will. Again, everything comes down to this. No matter how deep you dig into probability theory you will not find any other question and so you can save yourself a great deal of time by pondering this question in pure form rather than getting caught up in the nuances of probability theory.

(Okay, I’m not saying just avoid the whole of probability theory. It is indeed interesting. But I would advise against becoming obsessed, as I know how obsessive the structure of theory is. It could potentially — and I mean this literally — drive a person mad because it takes the form of an infinite series of questions which never provide any answers, simply because the meta-question is the one I just laid out above.)

But back to the monkey theorem for a moment. The theorem states that if a monkey sits at a typewriter hitting random keys it will eventually come up with the collected works of Shakespeare. When expressed in mathematical form the theorem makes sense, but when stated anecdotally and “brought back down to earth”, as in the monkey example, it makes no sense at all. First of all, a monkey’s behavior does not generate random walks. What the anecdote does is replace a truly random-generating machine with a monkey, but the analogy is incorrect because a monkey would not behave in a properly random manner. Secondly, infinity does not exist in our oh-so finite reality. It is either a figment of our imagination or it is some divine space inhabited by a higher power.

This is important because we should remember what we are really dealing with when we are dealing with such theorems. People often mistake these theorems as saying something tangible about our lived reality. But often this is simply not the case. What these theorems do is absorb and disguise debates that used to take place among metaphysicians and theologians and then pretend as if certain questions which philosophers have been tackling since time immemorial have been answered. One is tempted to put this down to the hubristic tendencies in the scientific method itself.

Whatever the reason, however, the lesson for the Sciences of Man should be clear: these questions have not been answered; methods derived from disciplines like probability theory (for example: econometrics) probably have a very limited reach; and you’re not going discover the secrets of the universe by becoming an expert in these disciplines, although society may bestow you with a role similar to that occupied by a priest or a haruspex in times past. If this is indeed your goal well, as Keynes said all those years ago, Newton, Locke and Boyle played at alchemy, so by all means continue.


About pilkingtonphil

Philip Pilkington is a macroeconomist and investment professional. Writing about all things macro and investment. Views my own.You can follow him on Twitter at @philippilk.
This entry was posted in Economic Theory, Philosophy. Bookmark the permalink.

4 Responses to Infinite Monkeys: The Limits of Probability Theory

  1. Lord Keynes says:

    Nice post!

    Do you have any thoughts on what should be a proper, defensible decision making theory for Post Keynesian economics?

    Also, have you ever bothered to understand the technical details of Keynes’s theory of probability? E.g., the minutiae of, say, his so-called non-linear subjective probability interval estimates?

    • Hey LK,

      (1) Are you referring to a theory of decision-making by economic agents? Or are you referring to a theory of how Post-Keynesians should make decisions about the validity of their arguments.

      The former questions doesn’t interest me too much. I can barely get a grip on why my friends and family act the way they act and think the way they think, to have a General Theory seems to be grandiose to the point of delusion. All we can really do here is come up with stylised facts — estimations of multipliers (i.e. savings decision); estimations of savings by income group; Duesenberry-style hypotheses about how people tend to spend; and so on. We should also recognise, as both Keynes and Kaldor always insisted, that stylised facts are not laws and should never be treated as such. If the data changes and you don’t change your mind then you should change your job.

      The latter question is fascinating. I think this is what Keynes is concerned with in his probability theories — although I think that he hit a rock which is why he stopped writing on such issues and just learned through practice; trial and error. I’m not sure that you can theorise this. It’s an art, as I wrote somewhere or other.

      (2) Honestly? No. I will some time, purely out of interest. But I started getting caught into this stuff a few months back and had to stop myself. It’s all-consuming and I’m 99.9999999% sure that it doesn’t lead anywhere (note the irony of me giving you an obviously false probability!). Again though, I’m going to read ToP in full and understand it properly when I have a two-week holiday or something in the sun where I can sit by a pool or something. But not now.

  2. Tom Hickey says:

    Examining human history, the future does not resemble the past since we inhabit a complex adaptive system in which humanity emerged and continues to develop. There may be resemblances in the short run but in the long run things change more than they stay the same.

    In fact, what human beings should be most concerned with now is the existential threat they may be facing, leading to a great culling or even extinction.

    Then there is also the great transformation taking place as we go from the industrial age to the information age, and from nation state as predominant to transnationalism and globalism.

    Where this is leading is radically uncertain, not only epistemically but also ontologically since it wil depend on feedback loops affecting the environment and subjective reflexivity, the outcome of which cannot be foreseen and is apparently not determined other than “in the mind of God.”

    • Well, I absolutely agree, as you know Tom. But one further thing: we can prove this logically.

      If I challenge you to come up with a theory of my behavior and you succeed (impossible, I know, but bear with me), you will have to keep this theory secret or it will not work. Why? If I know the theory I can change my behavior and thus disprove the theory. That quite literally proves, so far as I can see, that determinism is logically wrong.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s