Title :
Multivariate regression model selection with KIC for extrapolation cases
Author :
Seghouane, Abd-Krim
Author_Institution :
Syst. Eng. & Complex Syst. Program, Nat. ICT Australia Ltd., Canberra, ACT, Australia
fDate :
31 July-4 Aug. 2005
Abstract :
The Kullback information criterion, KIC and its multivariate bias-corrected version, KICVC are two alternatively developed criteria for model selection. The two criteria can be viewed as estimators of the expected Kullback symmetric divergence. In this paper, a new criterion is proposed in order to select a well fitted model for an extrapolation case. The proposed criterion is named, PKIC, where "P" stands for prediction, and is derived as an exact unbiased estimator of an adapted cost function that is based on the Kullback symmetric divergence and the future design matrix. PKIC is an unbiased estimator of its cost function assuming that the true model is correctly specified or overfitted. A simulation study illustrating that model selection with PKIC performs well for some extrapolation cases is presented.
Keywords :
extrapolation; regression analysis; Kullback information criterion; Kullback symmetric divergence; adapted cost function; multivariate bias-corrected version; multivariate regression model selection; unbiased estimator; Australia; Computer aided software engineering; Cost function; Covariance matrix; Electronic mail; Extrapolation; Multivariate regression; Predictive models; Symmetric matrices; Systems engineering and theory;
Conference_Titel :
Neural Networks, 2005. IJCNN '05. Proceedings. 2005 IEEE International Joint Conference on
Print_ISBN :
0-7803-9048-2
DOI :
10.1109/IJCNN.2005.1556040