Title :
Scanning and prediction in multidimensional data arrays
Author :
Merhav, Neri ; Weissman, Tsachy
Author_Institution :
Dept. of Electr. Eng., Technion-Israel Inst. of Technol., Haifa, Israel
fDate :
1/1/2003 12:00:00 AM
Abstract :
The problem of sequentially scanning and predicting data arranged in a multidimensional array is considered. We introduce the notion of a scandictor, which is any scheme for the sequential scanning and prediction of such multidimensional data. The scandictability of any finite (probabilistic) data array is defined as the best achievable expected "scandiction" performance on that array. The scandictability of any (spatially) stationary random field on Zm is defined as the limit of its scandictability on finite "boxes" (subsets of Zm), as their edges become large. The limit is shown to exist for any stationary field, and essentially be independent of the ratios between the box dimensions. Fundamental limitations on scandiction performance in both the probabilistic and the deterministic settings are characterized for the family of difference loss functions. We find that any stochastic process or random field that can be generated autoregressively with a maximum-entropy innovation process is optimally "scandicted" the way it was generated. These results are specialized for cases of particular interest. The scandictability of any stationary Gaussian field under the squared-error loss function is given a single-letter expression in terms of its spectral measure and is shown to be attained by the raster scan. For a family of binary Markov random fields (MRFs), the scandictability under the Hamming distortion measure is fully characterized.
Keywords :
Gaussian processes; Markov processes; array signal processing; autoregressive processes; data compression; error analysis; maximum entropy methods; multidimensional signal processing; prediction theory; probability; spectral analysis; Hamming distortion measure; autoregressive representations; binary Markov random fields; box dimensions; compression efficiency; data prediction; difference loss functions; finite probabilistic data; maximum-entropy innovation process; multidimensional data arrays; predictive coding; scandiction performance; scandictor; sequential data scanning; single-letter expression; spatially stationary random field; spectral measure; squared-error loss function; stationary Gaussian field; stochastic process; Distortion measurement; Helium; Image coding; Loss measurement; Markov random fields; Multidimensional systems; Performance loss; Predictive models; Stochastic processes; Technological innovation;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2002.806134