Title :
On the Variable Step-Size of Discrete-Time Zhang Neural Network and Newton Iteration for Constant Matrix Inversion
Author :
Zhang, Yunong ; Cai, Binghuang ; Liang, Mingjiong ; Ma, Weimu
Author_Institution :
Sch. of Inf. Sci. & Technol., Sun Yat-Sen Univ., Guangzhou
Abstract :
A special kind of recurrent neural network has recently been proposed by Zhang et al for matrix inversion. Then, for possible hardware and digital-circuit realization, the corresponding discrete-time model of Zhang neural network (ZNN) is proposed for constant matrix inversion, which reduces exactly to Newton iteration when linear activation functions and constat step-size 1 are used. In this paper, a variable step-size choosing method is investigated for such a discrete-time ZNN model, in which different variable step-size rules are derived for different kinds of activation functions. For comparative purposes, the fixed step-size choosing method is presented as well. Numerical examples demonstrate the efficacy of the discrete-time ZNN model, especially when using the variable step-size method.
Keywords :
discrete time systems; iterative methods; matrix inversion; recurrent neural nets; transfer functions; Newton iteration; constant matrix inversion; digital-circuit realization; discrete-time Zhang neural network; discrete-time model; linear activation functions; recurrent neural network; step-size choosing method; Application software; Convergence; Information science; Information technology; Intelligent networks; Neural network hardware; Neural networks; Problem-solving; Recurrent neural networks; Sun;
Conference_Titel :
Intelligent Information Technology Application, 2008. IITA '08. Second International Symposium on
Conference_Location :
Shanghai
Print_ISBN :
978-0-7695-3497-8
DOI :
10.1109/IITA.2008.128