https://www.wikiworld.com/index.php?action=history&feed=atom&title=InformationTheory 2026-05-06T14:11:17Z Revision history for this page on the wiki MediaWiki 1.45.1 https://www.wikiworld.com/index.php?title=InformationTheory&diff=1755&oldid=prev 2026-01-28T11:54:25Z

<p>Imported current content</p> <p><b>New page</b></p><div><br /> Claude E. Shannon&#039;s, 1948 &#039;&#039;&#039;&#039;A Mathematical Theory of Communication&#039;&#039;&#039;&#039; is basis and substance of Information Theory.<br /> <br /> Shannon defined a &#039;&#039;&#039;&#039;sender&#039;&#039;&#039;&#039; and a &#039;&#039;&#039;&#039;receiver&#039;&#039;&#039;&#039; of a &#039;&#039;&#039;&#039;signal&#039;&#039;&#039;&#039; on a &#039;&#039;&#039;&#039;channel&#039;&#039;&#039;&#039;.<br /> <br /> Information is always a measure of the decrease of uncertainty at a receiver.<br /> <br /> Specifically, Shannon defined information as the reduction in the uncertainty of the receiver about the state of the sender.<br /> <br /> He showed that information can be measured in a discrete number of &#039;&#039;&#039;&#039;bits&#039;&#039;&#039;&#039;, defined as conditional probabilities of the truth value being true.<br /> <br /> He formalized the information transfer on both a noiseless and noisy channel.<br /> <br /> His result was equivalent to entropy (disorder, S) in thermodynamics and he called his information measure entropy. Entropy is most often considered the loss of information yielding uncertainty. An increase in certainty or order is considered negative entropy or increased information.<br /> <br /> S = k log(W) is the entropy of a system with W possible states.<br /> <br /> http://en.wikipedia.org/wiki/Entropy<br /> <br /> Information plus uncertainty equals one.<br /> <br /> In general systems theory the entropy, or 2nd Law of the [[LawsOfThermodynamics]], says that the entropy of a system tends to increase. This leads to Eurler&#039;s formula for heat dissapation, and Schodingder&#039;s equation of quantum possibilitieties, but in quantum systems the interactions are non-linear and completely elastic and fail to progress toward equalibia dispite this tendency.<br /> <br /> http://cm.bell-labs.com/cm/ms/what/shannonday/paper.html<br /> ----<br /> Universal information systems may be enumerated as the networks of sender-receivers logically transforming information with a delay.<br /> ----<br /> Is disinformation relevant to information theory?<br /> <br /> <br /> [[InformationPhysics]]<br /> </div>

imported>Import