• DocumentCode
    305439
  • Title

    An urn model for instrumental conditioning

  • Author

    Liu, Changqing ; Zhang, Bo

  • Author_Institution
    Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
  • Volume
    3
  • fYear
    1996
  • fDate
    14-17 Oct 1996
  • Firstpage
    2327
  • Abstract
    Instrumental conditioning phenomena are fundamental to understanding human and animal learning. The learning process in conditioning phenomena is identified with updating of the action probabilities of the subjects. To account for the learning process, mathematical learning theory simply assumes certain closed form expressions for the updating of the action probabilities. However, there are no biological, psychological and physical grounds for these assumptions. In this paper we re-examine a classical paradigm of instrumental conditioning from a new perspective, and thereby abstract an urn model, which may provide a physical interpretation for the learning process. The concepts such as “motivation”, “reward”, “punishment”, etc. which previous theories might utilize in order to make themselves appear to be plausible, are not needed to account for the learning process
  • Keywords
    biocybernetics; physiological models; probability; action probability; animal learning; human learning; instrumental conditioning; motivation; punishment; reward; urn model; Animals; Automobiles; Biological system modeling; Computer science; Humans; Instruments; Learning; Pediatrics; Psychology; Robots;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Systems, Man, and Cybernetics, 1996., IEEE International Conference on
  • Conference_Location
    Beijing
  • ISSN
    1062-922X
  • Print_ISBN
    0-7803-3280-6
  • Type

    conf

  • DOI
    10.1109/ICSMC.1996.565533
  • Filename
    565533