Title :
Sequential network construction for time series prediction
Author :
Cholewo, Tomasz J. ; Zurada, Jacek M.
Author_Institution :
Dept. of Electr. Eng., Louisville Univ., KY, USA
Abstract :
This paper introduces an application of the sequential network construction (SNC) method to select the size of several popular neural network predictor architectures for various benchmark training sets. The specific architectures considered are a FIR network and the partially recurrent Elman network and its extension, with context units also added for the output layer. We consider an enhancement of a FIR network in which only those weights having relevant time delays are utilized. Bias-variance trade-off in relation to the prediction risk estimation by means of nonlinear cross-validation (NCV) is discussed. The presented approach is applied to the Wolfer sunspot number data and a Mackey-Glass chaotic time series. Results show that the best predictions for the Wolfer data are computed using a FIR neural network while for Mackey-Glass data an Elman network yields superior results
Keywords :
neural nets; prediction theory; time series; FIR neural network; Mackey-Glass chaotic time series; Wolfer sunspot number data; benchmark training sets; bias-variance trade-off; neural network predictor architectures; nonlinear cross-validation; partially recurrent Elman neural network; prediction risk estimation; sequential network construction; time series prediction; Chaos; Computer architecture; Computer networks; Delay effects; Finite impulse response filter; Learning systems; Multi-layer neural network; Neural networks; Neurons; Nonlinear filters;
Conference_Titel :
Neural Networks,1997., International Conference on
Conference_Location :
Houston, TX
Print_ISBN :
0-7803-4122-8
DOI :
10.1109/ICNN.1997.614214
