On the nature of information — An application of entropy

It is a most satisfying experience to be able to proceed from simple, intuitive, basic premises in a straight line to a sophisticated understanding of a very fundamental concept. Historically, most philosophical and scientific concepts in their development do not progress in this logical pattern. Most often progress is made or setbacks occur in a rather disjointed manner as the pressures and talents of the time are sporadically brought to bear on a particular problem area. It is only after much controversy, speculation, charges, and countercharges that hindsight shows us a clearer and more direct path through the morass. The uninitiated seeking a route to clarity is confronted with a jungle of information, and more often than not gives up in despair.