Title :
An approach to Synthesis and Analysis of Complex Recurrent Neural Network
Author :
Kostantin Nikolic;Borislav Abramovic;Ivan Scepanovic
Author_Institution :
Faculty of management Novi Sad, Department of Informatics, Novi Sad
Abstract :
This paper presents an approach to optimization of recurrent artificial neural networks (RNN) that leans on the appliance of stochastic search (SS). Favor algorithm SS with information accumulation (SSAI) is simple in numerical sense, and does not require a lot of computing time in the optimization process i.e. RNN training, and gives suboptimal results in comparison to gradient methods. In certain sense, suggested approach more appropriate for engineering practice than back propagation error (BPE) method, because it does not condition the differentiability of activation neuron function, as well as transformation of RNN in corresponding multi-layered network with forward propagation signal, and after that gave the problem with a great deal of dimensions. Behind the corresponding theoretical analysis, SSAI is applied on optimization of structure and RNN parameters (supervised learning algorithm), for creation of predictive model which serves for content of useful component in input raw material in technological process of flotation in real time
Keywords :
"Network synthesis","Recurrent neural networks","Artificial neural networks","Home appliances","Stochastic processes","Gradient methods","Neurons","Algorithm design and analysis","Supervised learning","Predictive models"
Conference_Titel :
Neural Network Applications in Electrical Engineering, 2006. NEUREL 2006. 8th Seminar on
Print_ISBN :
1-4244-0432-0
DOI :
10.1109/NEUREL.2006.341180