Title :
A fast identification algorithm for box-cox transformation based radial basis function neural network
Author_Institution :
Dept. of Cybern., Reading Univ., UK
fDate :
7/1/2006 12:00:00 AM
Abstract :
In this letter, a Box-Cox transformation-based radial basis function (RBF) neural network is introduced using the RBF neural network to represent the transformed system output. Initially a fixed and moderate sized RBF model base is derived based on a rank revealing orthogonal matrix triangularization (QR decomposition). Then a new fast identification algorithm is introduced using Gauss-Newton algorithm to derive the required Box-Cox transformation, based on a maximum likelihood estimator. The main contribution of this letter is to explore the special structure of the proposed RBF neural network for computational efficiency by utilizing the inverse of matrix block decomposition lemma. Finally, the Box-Cox transformation-based RBF neural network, with good generalization and sparsity, is identified based on the derived optimal Box-Cox transformation and a D-optimality-based orthogonal forward regression algorithm. The proposed algorithm and its efficacy are demonstrated with an illustrative example in comparison with support vector machine regression.
Keywords :
Gaussian processes; Newton method; matrix decomposition; maximum likelihood estimation; radial basis function networks; regression analysis; support vector machines; transforms; Box-Cox transformation; D-optimality-based orthogonal forward regression algorithm; Gauss-Newton algorithm; QR decomposition; computational efficiency; fast identification algorithm; inverse matrix block decomposition lemma; maximum likelihood estimator; radial basis function neural network; rank revealing orthogonal matrix triangularization; support vector machine regression; Additive noise; Computational efficiency; Gaussian processes; Least squares approximation; Matrix decomposition; Maximum likelihood estimation; Neural networks; Parameter estimation; Radial basis function networks; Support vector machines; Box–Cox transform; Gauss–Newton algorithm; QR decomposition; forward regression; radial basis function; subset selection;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2006.875986