DocumentCode :
2955958
Title :
A new multidimensional penalized likelihood regression method
Author :
Hassan, Mostafa M. ; Atiya, Amir F. ; El-Fouly, Raafat
Author_Institution :
Comput. Eng. Dept., Cairo Univ., Giza
fYear :
2008
fDate :
1-8 June 2008
Firstpage :
933
Lastpage :
938
Abstract :
Penalized likelihood regression is a concept whereby the log-likelihood of the observations is combined with a term measuring the smoothness of the fit, and the resulting expression is then optimized. This concept vies for achieving a compromise between goodness of fit (as typified by the likelihood function) and smoothness of the data. Penalized likelihood regression, which has been developed in the statistics literature since the seventies, has focused mostly on the one-dimensional case. Attempts to consider the general multidimensional case have been limited. In this paper we propose a new multidimensional penalized likelihood regression method. The approach is based on proposing a roughness term based on the discrepancy between the function values among the K-nearest-neighbors. The proposed formulation yields a simple solution in terms of a system of linear equations. We also derive an iterative solution to the problem that sheds light on its basic functionality. The iteration consists of repeatedly taking the weighted average of the target output value and the estimated function values of the K-nearest-neighbors. We show that the proposed model is fairly versatile in that it exhibits nice features in handling user-defined function constraints and data imperfections. Experimental results confirm that it is competitive with the Gaussian process regression method (one of the best methods out there), and exhibits significant speed advantage.
Keywords :
data handling; iterative methods; regression analysis; Gaussian process regression method; K-nearest-neighbors; data handling; iterative solution; linear equations; multidimensional penalized likelihood regression method; observations log-likelihood; Bayesian methods; Equations; Gaussian processes; Information technology; Iterative methods; Multidimensional systems; Optimization methods; Parametric statistics; Probability; Spline;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE International Joint Conference on
Conference_Location :
Hong Kong
ISSN :
1098-7576
Print_ISBN :
978-1-4244-1820-6
Electronic_ISBN :
1098-7576
Type :
conf
DOI :
10.1109/IJCNN.2008.4633911
Filename :
4633911
Link To Document :
بازگشت