Title :
Evolution of recollection and prediction in neural networks
Author :
Chung, Ji Ryang ; Kwon, Jaerock ; Choe, Yoonsuck
Author_Institution :
Dept. of Comput. Sci. & Eng., Texas A&M Univ., College Station, TX, USA
Abstract :
A large number of neural network models are based on a feedforward topology (perceptrons, backpropagation networks, radial basis functions, support vector machines, etc.), thus lacking dynamics. In such networks, the order of input presentation is meaningless (i.e., it does not affect the behavior) since the behavior is largely reactive. That is, such neural networks can only operate in the present, having no access to the past or the future. However, biological neural networks are mostly constructed with a recurrent topology, and recurrent (artificial) neural network models are able to exhibit rich temporal dynamics, thus time becomes an essential factor in their operation. In this paper, we will investigate the emergence of recollection and prediction in evolving neural networks. First, we will show how reactive, feedforward networks can evolve a memory-like function (recollection) through utilizing external markers dropped and detected in the environment. Second, we will investigate how recurrent networks with more predictable internal state trajectory can emerge as an eventual winner in evolutionary struggle when competing networks with less predictable trajectory show the same level of behavioral performance. We expect our results to help us better understand the evolutionary origin of recollection and prediction in neuronal networks, and better appreciate the role of time in brain function.
Keywords :
backpropagation; brain; feedforward neural nets; neurophysiology; perceptrons; recurrent neural nets; topology; backpropagation networks; biological neural networks; brain function; feedforward networks; feedforward topology; internal state trajectory; memory-like function; neuronal networks; perceptrons; predictable trajectory; radial basis functions; recurrent artificial neural network models; recurrent topology; support vector machines; temporal dynamics; Artificial neural networks; Backpropagation; Biological neural networks; Evolution (biology); Feedforward neural networks; Network topology; Neural networks; Recurrent neural networks; Support vector machines; Trajectory;
Conference_Titel :
Neural Networks, 2009. IJCNN 2009. International Joint Conference on
Conference_Location :
Atlanta, GA
Print_ISBN :
978-1-4244-3548-7
Electronic_ISBN :
1098-7576
DOI :
10.1109/IJCNN.2009.5179065