Title :
Model of the interactions between neuromodulators and prefrontal cortex during a resource allocation task
Author :
Chelian, Suhas E. ; Oros, N. ; Zaldivar, A. ; Krichmar, Jeffrey L. ; Bhattacharyya, R.
Author_Institution :
Inf. Syst. & Sci. Lab., HRL Labs., LLC, Malibu, CA, USA
Abstract :
Neuromodulators such as dopamine (DA), serotonin (5-HT), and acetylcholine (ACh) are crucial to the representations of reward, cost, and attention respectively. Recent experiments suggest that the reward and cost of actions are also partially represented in orbitofrontal and anterior cingulate cortices in that order. Previous models of action selection with neuromodulatory systems have not extensively considered prefrontal contributions to action selection. Here, we extend these models of action selection to include prefrontal structures in a resource allocation task. The model adapts to its environment, modulating its aggressiveness based on its successes. Selective lesions demonstrate how neuromodulatory and prefrontal areas drive learning and performance of strategy selection.
Keywords :
neurophysiology; resource allocation; 5-HT; acetylcholine; action selection; anterior cingulate cortices; dopamine; neuromodulators; neuromodulatory systems; orbitofrontal cingulate cortices; prefrontal areas; prefrontal cortex; prefrontal structures; resource allocation task; selective lesions; serotonin; strategy selection; Adaptation models; Brain modeling; Fires; Firing; Lesions; Neurons; Resource management; Computational Neuroscience; Cost; Decision-Making; Neuromodulation; Policy Search; Reward;
Conference_Titel :
Development and Learning and Epigenetic Robotics (ICDL), 2012 IEEE International Conference on
Conference_Location :
San Diego, CA
Print_ISBN :
978-1-4673-4964-2
Electronic_ISBN :
978-1-4673-4963-5
DOI :
10.1109/DevLrn.2012.6400811