Title of article :
A small sample model selection criterion based on Kullbackʹs symmetric divergence
Author/Authors :
Seghouane، نويسنده , , A.-K.  Bekara، نويسنده , , M.، نويسنده ,
Issue Information :
روزنامه با شماره پیاپی سال 2004
Pages :
10
From page :
3314
To page :
3323
Abstract :
The Kullback information criterion (KIC) is a recently developed tool for statistical model selection. KIC serves as an asymptotically unbiased estimator of a variant (within a constant) of the Kullback symmetric divergence, known also as J-divergence between the generating model and the fitted candidate model. In this paper, a bias correction to KIC is derived for linear regression models. The correction is of particular use when the sample size is small or when the number of fitted parameters is a moderate to large fraction of the sample size. For linear regression models, the corrected criterion, called KICc is an exactly unbiased estimator of the variant of the Kullback symmetric divergence, assuming that the true model is correctly specified or overfitted. Furthermore, when applied to polynomial regression and autoregressive time-series modeling, KICc is found to estimate the model order more accurately than any other asymptotically efficient method. Finally, KICc is tested on real data to forecast foreign currency exchange rate; the result is very interesting in comparison to classical techniques.
Keywords :
AICc , Autoregressive time series , Kullback–Leibler information , model selection. , KIC , AIC
Journal title :
IEEE TRANSACTIONS ON SIGNAL PROCESSING
Serial Year :
2004
Journal title :
IEEE TRANSACTIONS ON SIGNAL PROCESSING
Record number :
403672
Link To Document :
بازگشت