DocumentCode
2980996
Title
Fisher information determinant and stochastic complexity for Markov models
Author
Takeuchi, Jun Ichi
Author_Institution
Fac. of Inf., Kyushu Univ., Fukuoka, Japan
fYear
2009
fDate
June 28 2009-July 3 2009
Firstpage
1894
Lastpage
1898
Abstract
We study Fisher information of stationary Markov models with a finite alphabet. In particular, we derive the Fisher information determinant of expectation parameter eta, which is defined as expectation of Markov type. The Fisher information determinant with respect to Markov kernel parameter (conditional probabilities) is easy to find, while it is not so with respect to the expectation parameter eta nor the natural parameter thetas. Note that thetas and eta are of special importance for exponential families including Markov models.
Keywords
Markov processes; computational complexity; determinants; information theory; parameter estimation; Fisher information determinant; Markov kernel parameter; Markov models; expectation parameter; finite alphabet; stochastic complexity; Data compression; Informatics; Jacobian matrices; Kernel; Parametric statistics; Predictive models; Stochastic processes;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory, 2009. ISIT 2009. IEEE International Symposium on
Conference_Location
Seoul
Print_ISBN
978-1-4244-4312-3
Electronic_ISBN
978-1-4244-4313-0
Type
conf
DOI
10.1109/ISIT.2009.5205510
Filename
5205510
Link To Document