DocumentCode
913747
Title
Entropy analysis of estimating systems
Author
Weidemann, Henry L. ; Stear, Edwin B.
Volume
16
Issue
3
fYear
1970
fDate
5/1/1970 12:00:00 AM
Firstpage
264
Lastpage
270
Abstract
A study of the use of entropy as a criterion function for analyzing the performance of sampled-data estimating systems is presented, and performance bounds are obtained for a broad class of such systems. The general result is that the difference between the entropy of the signal to be estimated and the entropy of its estimate based on the output of a noisy sensor can never be larger than the mutual information between the sensor input and output. An interesting, but not totally satisfactory, sufficient condition for attainment of the bound is developed.
Keywords
Entropy functions; Estimation; Channel capacity; Communication systems; Control systems; Entropy; Information theory; Mean square error methods; Mutual information; Performance analysis; Rate-distortion; Sensor systems;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1970.1054444
Filename
1054444
Link To Document