Superstitious Pigeons

from 'Supertition' in the Pigeon by B.F.Skinner

A pigeon is brought to a stable state of hunger by reducing it to 75 percent of its weight when well fed. It is put into an experimental cage for a few minutes each day. A food hopper attached to the cage may be swung into place so that the pigeon can eat from it. A solenoid and a timing relay hold the hopper in place for five sec. at each reinforcement.

If a clock is now arranged to present the food hopper at regular intervals with no reference whatsoever to the bird's behavior, operant conditioning usually takes place. In six out of eight cases the resulting responses were so clearly defined that two observers could agree perfectly in counting instances. One bird was conditioned to turn counter-clockwise about the cage, making two or three turns between reinforcements. Another repeatedly thrust its head into one of the upper corners of the cage. A third developed a 'tossing' response, as if placing its head beneath an invisible bar and lifting it repeatedly. Two birds developed a pendulum motion of the head and body, in which the head was extended forward and swung from right to left with a sharp movement followed by a somewhat slower return. The body generally followed the movement and a few steps might be taken when it was extensive. Another bird was conditioned to make incomplete pecking or brushing movements directed toward but not touching the floor. None of these responses appeared in any noticeable strength during adaptation to the cage or until the food hopper was periodically presented. In the remaining two cases, conditioned responses were not clearly marked.

The conditioning process is usually obvious. The bird happens to be executing some response as the hopper appears; as a result it tends to repeat this response. If the interval before the next presentation is not so great that extinction takes place, a second 'contingency' is probable. This strengthens the response still further and subsequent reinforcement becomes more probable. It is true that some responses go unreinforced and some reinforcements appear when the response has not just been made, but the net result is the development of a considerable state of strength.

Charlie Munger says this about Skinnerian association -

Now you've got bios from Skinnerian association: operant conditioning, you know, where you give the dog a reward and pound in the behavior that preceded the dog's getting the award. And, of course, Skinner was able to create superstitious pigeons by having the rewards come by accident with certain occurrences, and, of course, we all know people who are the human equivalents of superstitious pigeons. That's a very powerful phenomenon. And, of course, operant conditioning really works. I mean the people in the center who think that operant conditioning is important are very much right, it's just that Skinner overdid it a little.

Where you see in business just perfectly horrible results from psychologically-rooted tendencies is in accounting. If you take Westinghouse, which blew, what, two or three billion dollars pre-tax at least loaning developers to build hotels, and virtually 100% loans? Now you say any idiot knows that if there's one thing you don't like it's a developer, and another you don't like it's a hotel. And to make a 100% loan to a developer who's going to build a hotel… [Laughter] But this guy, he probably was an engineer or something, and he didn't take psychology any more than I did, and he got out there in the hands of these salesmen operating under their version of incentive-caused bias, where any damned way of getting Westinghouse to do it was considered normal business, and they just blew it.

That would never have been possible if the accounting system hadn't been such but for the initial phase of every transaction it showed wonderful financial results. So people who have loose accounting standards are just inviting perfectly horrible behavior in other people. And it's a sin, it's an absolute sin. If you carry bushel baskets full of money through the ghetto, and made it easy to steal, that would be a considerable human sin, because you'd be causing a lot of bad behavior, and the bad behavior would spread. Similarly an institution that gets sloppy accounting commits a real human sin, and it's also a dumb way to do business, as Westinghouse has so wonderfully proved.

Oddly enough nobody mentions, at least nobody I've seen, what happened with Joe Jett and Kidder Peabody. The truth of the matter is the accounting system was such that by punching a few buttons, the Joe Jetts of the world could show profits, and profits that showed up in things that resulted in rewards and esteem and every other thing... Well the Joe Jetts are always with us, and they're not really to blame, in my judgment at least. But that bastard who created that foolish accounting system who, so far as I know, has not been flayed alive, ought to be.

Popular posts from this blog

It Pays to be a Nervous Wreck

Korean Model

Maxims from Poor Richard 3