Title :
Estimation of size of hidden layer on basis of bound of generalization error
Author :
Igelnik, Boris ; Pao, Yoh-Han
Author_Institution :
Dept. of Electr. Eng. & Appl. Phys., Case Western Reserve Univ., Cleveland, OH, USA
Abstract :
For the class of functions with regularity expressed in terms of its Fourier transform, a simple algorithm is suggested for estimation of the size of single hidden layer feedforward neural network for approximating a function from the given class. We applied this algorithm to the architecture of the single hidden layer neural network, namely the random version of the functional-link net (FLN). Discussion of generalization capabilities of the FLN is presented. The algorithm is based on the bound, derived by Barren (1993), for the mean integrated squared error between the network estimate and the target function. It determines the estimate of the minimal number of nodes sufficient to guarantee that the error be less than a prescribed level, if this level of error is achievable for the given training data. In the opposite case the algorithm finds estimate of the size of the network which guarantees that the error be within a small interval containing the minimal achievable value of the error. An iterative procedure of the algorithm allows one to avoid the need for involved calculations of the constants contained in the bound
Keywords :
Fourier transforms; feedforward neural nets; function approximation; generalisation (artificial intelligence); iterative methods; parameter estimation; Fourier transform; feedforward neural network; function approximation; functional-link net; generalization error; iterative procedure; mean integrated squared error; size estimation; target function; Artificial intelligence; Erbium; Feedforward neural networks; Fourier transforms; Integral equations; Iterative algorithms; Neural networks; Physics; Training data;
Conference_Titel :
Neural Networks, 1995. Proceedings., IEEE International Conference on
Conference_Location :
Perth, WA
Print_ISBN :
0-7803-2768-3
DOI :
10.1109/ICNN.1995.488964