Title :
A new EM algorithm using Tikhonov regularization
Author :
Koshizen, Takamasa ; Rosseel, Yves ; Tonegawa, Yoshihiro
Author_Institution :
Dept. of Syst. Eng., Australian Nat. Univ., Canberra, ACT, Australia
Abstract :
A new expectation-maximization (EM) algorithm which employs Tikhonov regularization is proposed. In this paper we use the new algorithm to estimate the parameters of a Gaussian mixture model. Two learning steps are involved: first the standard EM algorithm is used to get an initial estimate of the parameters; next, a regularized version of the EM algorithm is used to improve the smoothness and generalization properties of the estimated density function. To illustrate the effectiveness of the approach, both the standard EM algorithm and the new regularized EM algorithm are compared in a density estimation task, using an artificial dataset. The results clearly indicate that the regularized EM algorithm leads to better estimates in terms of smoothness and generalization capabilities
Keywords :
Gaussian distribution; generalisation (artificial intelligence); maximum likelihood estimation; EM algorithm; Gaussian mixture model; Tikhonov regularization; density estimation task; estimated density function; expectation-maximization algorithm; generalization; parameter estimation; smoothness; Approximation algorithms; Density functional theory; Distributed computing; Function approximation; H infinity control; Mathematical model; Mathematics; Parameter estimation; Psychology; Systems engineering and theory;
Conference_Titel :
Neural Networks, 1999. IJCNN '99. International Joint Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-5529-6
DOI :
10.1109/IJCNN.1999.831530