Title :
Entropy with Limited Computation Resources
Author :
Sohangir, S. ; Linscott, I.
Author_Institution :
Stanford Univ., Stanford
Abstract :
We consider information in presence of computation limitations. Specifically, we consider the following question. What is the output entropy of a computation if no (or limited) computation resources are available. We first explain two notions of effective input information and the average number of decisions in a computation problem and show how these notions can helps us understand the output entropy of a computation when computation resources are limited. Then we propose a procedure to evaluate output entropy in such scenarios and show that it satisfies some nice properties.
Keywords :
computational complexity; entropy; computation complexity; information theory; limited computation resources; output entropy; Boolean functions; Circuits; Complexity theory; Computer networks; Distributed computing; Entropy; Information analysis; Information theory; Probability distribution; Very large scale integration;
Conference_Titel :
Information Theory, 2007. ISIT 2007. IEEE International Symposium on
Conference_Location :
Nice
Print_ISBN :
978-1-4244-1397-3
DOI :
10.1109/ISIT.2007.4557274