Title :
A new class of wavelet networks for nonlinear system identification
Author :
Billings, Stephen A. ; Wei, Hua-Liang
Author_Institution :
Dept. of Autom. Control & Syst. Eng., Univ. of Sheffield, UK
fDate :
7/1/2005 12:00:00 AM
Abstract :
A new class of wavelet networks (WNs) is proposed for nonlinear system identification. In the new networks, the model structure for a high-dimensional system is chosen to be a superimposition of a number of functions with fewer variables. By expanding each function using truncated wavelet decompositions, the multivariate nonlinear networks can be converted into linear-in-the-parameter regressions, which can be solved using least-squares type methods. An efficient model term selection approach based upon a forward orthogonal least squares (OLS) algorithm and the error reduction ratio (ERR) is applied to solve the linear-in-the-parameters problem in the present study. The main advantage of the new WN is that it exploits the attractive features of multiscale wavelet decompositions and the capability of traditional neural networks. By adopting the analysis of variance (ANOVA) expansion, WNs can now handle nonlinear identification problems in high dimensions.
Keywords :
least squares approximations; neural nets; nonlinear systems; parameter estimation; regression analysis; wavelet transforms; analysis of variance expansion; error reduction ratio; forward orthogonal least squares algorithm; high dimensional system; linear in the parameter regression; model structure; multivariate nonlinear network; neural network; nonlinear system identification; truncated wavelet decomposition; wavelet networks; Analysis of variance; Artificial neural networks; Continuous wavelet transforms; Discrete wavelet transforms; Feedforward neural networks; Least squares methods; Modeling; Neural networks; Nonlinear systems; Signal processing algorithms; Nonlinear autoregressive with exogenous inputs (NARX) models; nonlinear system identification; orthogonal least squares (OLS); wavelet networks (WNs); Algorithms; Computer Simulation; Computing Methodologies; Fuzzy Logic; Models, Biological; Models, Statistical; Neural Networks (Computer); Nonlinear Dynamics; Numerical Analysis, Computer-Assisted; Pattern Recognition, Automated; Signal Processing, Computer-Assisted; Stochastic Processes;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2005.849842