Title :
The Maximum Entropy Principle in the Absence of a Time-Arrow: Fractional-Pole Models
Author :
Georgiou, Tryphon T.
Author_Institution :
Univ. of Minnesota, Minneapolis
Abstract :
The maximum entropy (ME) principle, as it is often invoked in the context of time-series analysis, suggests the selection of a power spectrum which is consistent with autocorrelation data and corresponds to a random process least predictable from past observations. We introduce and compare a class of spectra with the property that the underlying random process is least predictable at any given point from the complete set of past and future observations. In this context, randomness is quantified by the size of the corresponding smoothing error and deterministic processes are characterized by integrability of the inverse of their power spectral densities - as opposed to the log-integrability in the classical setting. The power spectrum which is consistent with a partial autocorrelation sequence and corresponds to the most random (MR) process in this new sense, is no longer rational but generated by finitely many fractional-poles.
Keywords :
maximum entropy methods; random processes; smoothing methods; spectral analysis; deterministic process characterization; fractional-pole model; maximum entropy principle; partial autocorrelation sequence; power spectral density; power spectrum selection; random process; randomness quantification; smoothing error; time-series analysis; Autocorrelation; Context modeling; Entropy; Power generation; Predictive models; Random processes; Sensor arrays; Smoothing methods; Spectral analysis; Time series analysis; Entropy rate; predictability; randomness; smoothing; time-arrow;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2007.901149