Title :
Nonuniform Markov models
Author :
Ristad, Eric Sven ; Thomas, Robert G.
Author_Institution :
Dept. of Comput. Sci., Princeton Univ., NJ, USA
Abstract :
Proposes a new way to model conditional independence in Markov models. The central feature of our nonuniform Markov model is that it makes predictions of varying lengths using contexts of varying lengths. Experiments on the Wall Street Journal reveal that the nonuniform model performs slightly better than the classic interpolated Markov model of Jelinek and Mercer (1980). This result is somewhat remarkable because both models contain identical numbers of parameters whose values are estimated in a similar manner. The only difference between the two models is how they combine the statistics of longer and shorter strings
Keywords :
Markov processes; formal languages; parameter estimation; statistics; Wall Street Journal; conditional independence; context length; interpolated Markov model; nonuniform Markov models; parameter numbers; parameter value estimation; prediction length; statistical language models; string length statistics; Computer science; Context modeling; Heuristic algorithms; History; Interpolation; Predictive models; Probability; Smoothing methods; Statistics;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 1997. ICASSP-97., 1997 IEEE International Conference on
Conference_Location :
Munich
Print_ISBN :
0-8186-7919-0
DOI :
10.1109/ICASSP.1997.596046