Title :
Expanding the Go/NoGo depiction of the action of Basal Ganglia pathways
Author :
Kumar, K. Sanjeeva ; Maithreye, R. ; Gupte, N. ; Chakravarthy, V.S.
Author_Institution :
Dept. of Biotechnol., Indian Inst. of Technol., Chennai, India
fDate :
July 31 2011-Aug. 5 2011
Abstract :
We present a neuronal network model of Basal Ganglia that departs from the classical Go/NoGo picture of the function of its key pathways - the direct and indirect pathways (DP & IP). The model is instantiated in a simple action selection task. Striatal dopamine is assumed to switch between DP and IP activation. Simulations reveal that between the Go and NoGo regimes, exhibited at extreme values of dopamine, the system displays, at intermediate values of dopamine, a new Explore regime, which enables it to explore the space of action alternatives. The exploratory dynamics originates from the chaotic dynamics of pallido-subthalamic loop. Following the tradition of applying reinforcement learning (RL) concepts to BG function, we associate this new regime with the Explorer, a key component in Actor-Critic framework.
Keywords :
learning (artificial intelligence); neural nets; Go/NoGo depiction; action selection task; actor-critic framework; basal ganglia pathways; chaotic dynamics; exploratory dynamics; explore regime; indirect pathways; neuronal network model; pallido-subthalamic loop; reinforcement learning; striatal dopamine; Basal ganglia; Brain modeling; Chaos; Computational modeling; Firing; IP networks; Neurons;
Conference_Titel :
Neural Networks (IJCNN), The 2011 International Joint Conference on
Conference_Location :
San Jose, CA
Print_ISBN :
978-1-4244-9635-8
DOI :
10.1109/IJCNN.2011.6033646