THE CONCEPT OF ENTROPY AND ITS PROPERTIES

In this paper, we introduce entropy and its properties. Conditional entropy, Relative entropy and mutual information are other important concepts to be informed about them.