Thursday, November 21, 2024 Text is available under the CC BY-SA 3.0 licence.

Claude Elwood Shannon

« All quotes from this author
 

My greatest concern was what to call it. I thought of calling it 'information,' but the word was overly used, so I decided to call it 'uncertainty.' When I discussed it with John von Neumann, he had a better idea. Von Neumann told me, 'You should call it entropy, for two reasons. In the first place your uncertainty function has been used in statistical mechanics under that name, so it already has a name. In the second place, and more important, no one really knows what entropy really is, so in a debate you will always have the advantage.'
--
Scientific American 1971 , volume 225 , page 180
--
Explaining why he named his uncertainty function "entropy".

 
Claude Elwood Shannon

» Claude Elwood Shannon - all quotes »



Tags: Claude Elwood Shannon Quotes, Authors starting by S


Similar quotes

 

Use "entropy" and you can never lose a debate, von Neumann told Shannon - because no one really knows what "entropy" is.

 
William Poundstone
 

[John] von Neumann gave me an interesting idea: that you don't have to be responsible for the world that you're in. So I have developed a very powerful sense of social irresponsibility as a result of von Neumann's advice. It's made me a very happy man ever since. But it was von Neumann who put the seed in that grew into my active irresponsibility!

 
Richard Feynman
 

There was a seminar for advanced students in Zürich that I was teaching and von Neumann was in the class. I came to a certain theorem, and I said it is not proved and it may be difficult. Von Neumann didn't say anything but after five minutes he raised his hand. When I called on him he went to the blackboard and proceeded to write down the proof. After that I was afraid of von Neumann.

 
George Polya
 

The only student of mine I was ever intimidated by. He was so quick. There was a seminar for advanced students in Zürich that I was teaching and von Neumann was in the class. I came to a certain theorem, and I said it is not proved and it may be difficult. Von Neumann didn't say anything but after five minutes he raised his hand. When I called on him he went to the blackboard and proceeded to write down the proof. After that I was afraid of von Neumann.

 
John von Neumann
 

The Principle of Uncertainty is a bad name. In science, or outside of it, we are not uncertain; our knowledge is merely confined, within a certain tolerance. We should call it the Principle of Tolerance. And I propose that name in two senses. First, in the engineering sense: Science has progressed, step by step, the most successful enterprise in the ascent of man, because it has understood that the exchange of information between man and nature, and man and man, can only take place with a certain tolerance. But second, I also use the word, passionately, about the real world. All knowledge – all information between human beings – can only be exchanged within a play of tolerance. And that is true whether the exchange is in science, or in literature, or in religion, or in politics, or in any form of thought that aspires to dogma. It's a major tragedy of my lifetime and yours that scientists were refining, to the most exquisite precision, the Principle of Tolerance – and turning their backs on the fact that all around them, tolerance was crashing to the ground beyond repair. The Principle of Uncertainty or, in my phrase, the Principle of Tolerance, fixed once for all the realization that all knowledge is limited. It is an irony of history that at the very time when this was being worked out, there should rise, under Hitler in Germany and other tyrants elsewhere, a counter-conception: a principle of monstrous certainty. When the future looks back on the 1930s, it will think of them as a crucial confrontation of culture as I have been expounding it – the ascent of man against the throwback to the despots' belief that they have absolute certainty.

 
Jacob Bronowski
© 2009–2013Quotes Privacy Policy | Contact