Title :
An Adaptive System Identification Algorithm with a General Performance Index Based on Entropy Optimization
Author :
Yan, Liu ; Xuemei, Ren ; Zibin, Wang ; Jing, Na
Author_Institution :
Beijing Inst. of Technol., Beijing
Abstract :
This paper presents an entropy minimization algorithm for nonlinear system identification based on the information theory. The Parzen windowing estimator is used to approximate the entropy when the probability density functions of the variances can not be known as a priori or the variances are not realistically expressed with the traditional probability density functions. A general performance index based on the information entropy is discussed in this paper. Minimizing the performance index adopted can make the desired output of the adaptive system being tracked directly by the output of the neural network identifier. Furthermore, this performance index can be easily extended when treating other control problems. The performance of the entropy optimal algorithm is shown by several simulations with backpropagation neural networks.
Keywords :
backpropagation; entropy; minimisation; neural nets; probability; Parzen windowing estimator; adaptive system identification algorithm; backpropagation neural networks; entropy minimization algorithm; entropy optimization; information entropy; neural network identifier; nonlinear system identification; probability density functions; Adaptive systems; Backpropagation algorithms; Information entropy; Information theory; Minimization methods; Neural networks; Nonlinear systems; Performance analysis; Probability density function; System identification; Backpropagation; Entropy optimization; Identification; Neural networks; Parzen windowing;
Conference_Titel :
Control Conference, 2007. CCC 2007. Chinese
Conference_Location :
Hunan
Print_ISBN :
978-7-81124-055-9
Electronic_ISBN :
978-7-900719-22-5
DOI :
10.1109/CHICC.2006.4347327