Title :
Investigation of complex dynamics in a recurrent neural network with network community structure and asymmetric weight matrix
Author :
Berardo de Sousa, Fabiano ; Liang Zhao
Author_Institution :
Inst. of Math. & Comput. Sci., Univ. of Sao Paulo, São Carlos, Brazil
Abstract :
The cerebral cortex is a complex network. It contains billions of neurons divided in spatial and functional clusters to perform different tasks. It also operates with complex dynamics such as periodic and chaotic ones. It has been shown that chaotic neural networks are more efficient than conventional recurrent neural networks in avoiding spurious memory. Inspired by the fact that the cerebral cortex has specific groups of cells, in this paper we investigate the dynamic of a recurrent neural network where neurons are coupled in such a way that form communities of a complex network. Also, we generate an asymmetric weight matrix placing pattern cycles during learning. Such a learning rule provides a natural periodic behavior in a fully connected network. Community structure breaks the connections up, forcing chaos to emerge. Our study shows that chaotic behavior rises for a high fragmentation degree in either just one community with sparse connections or several communities with few inter-community connections. For the latter case, we also show that the neural network can hold chaotic dynamic and a high value of modularity measure at the same time. These findings provide an alternative way to design dynamical neural networks to perform pattern recognition tasks exploiting periodic and chaotic dynamics.
Keywords :
chaos; complex networks; learning (artificial intelligence); matrix algebra; network theory (graphs); pattern recognition; recurrent neural nets; asymmetric weight matrix; cerebral cortex; chaotic behavior; chaotic dynamic; complex dynamics; complex network; dynamical neural network design; fragmentation degree; fully connected network; intercommunity connections; learning rule; natural periodic behavior; network community structure; pattern cycles; pattern recognition tasks; periodic dynamics; recurrent neural network dynamics; sparse connections; Biological neural networks; Communities; Mathematical model; Neurons; Orbits; Time series analysis;
Conference_Titel :
Neural Networks (IJCNN), The 2013 International Joint Conference on
Conference_Location :
Dallas, TX
Print_ISBN :
978-1-4673-6128-6
DOI :
10.1109/IJCNN.2013.6706846