• DocumentCode
    1434915
  • Title

    ARPOP: An Appetitive Reward-Based Pseudo-Outer-Product Neural Fuzzy Inference System Inspired From the Operant Conditioning of Feeding Behavior in Aplysia

  • Author

    Eng Yeow Cheu ; Chai Quek ; See Kiong Ng

  • Author_Institution
    Center for Comput. Intell., Nanyang Technol. Univ., Singapore, Singapore
  • Volume
    23
  • Issue
    2
  • fYear
    2012
  • Firstpage
    317
  • Lastpage
    329
  • Abstract
    Appetitive operant conditioning in Aplysia for feeding behavior via the electrical stimulation of the esophageal nerve contingently reinforces each spontaneous bite during the feeding process. This results in the acquisition of operant memory by the contingently reinforced animals. Analysis of the cellular and molecular mechanisms of the feeding motor circuitry revealed that activity-dependent neuronal modulation occurs at the interneurons that mediate feeding behaviors. This provides evidence that interneurons are possible loci of plasticity and constitute another mechanism for memory storage in addition to memory storage attributed to activity-dependent synaptic plasticity. In this paper, an associative ambiguity correction-based neuro-fuzzy network, called appetitive reward-based pseudo-outer-product-compositional rule of inference [ARPOP-CRI(S)], is trained based on an appetitive reward-based learning algorithm which is biologically inspired by the appetitive operant conditioning of the feeding behavior in Aplysia. A variant of the Hebbian learning rule called Hebbian concomitant learning is proposed as the building block in the neuro-fuzzy network learning algorithm. The proposed algorithm possesses the distinguishing features of the sequential learning algorithm. In addition, the proposed ARPOP-CRI(S) neuro-fuzzy system encodes fuzzy knowledge in the form of linguistic rules that satisfies the semantic criteria for low-level fuzzy model interpretability. ARPOP-CRI(S) is evaluated and compared against other modeling techniques using benchmark time-series datasets. Experimental results are encouraging and show that ARPOP-CRI(S) is a viable modeling technique for time-variant problem domains.
  • Keywords
    Hebbian learning; biology computing; computational linguistics; fuzzy reasoning; neural nets; neurophysiology; time series; ARPOP-CRI; Aplysia; Hebbian concomitant learning; Hebbian learning rule; activity dependent neuronal modulation; activity dependent synaptic plasticity; appetitive operant conditioning; appetitive reward based learning algorithm; appetitive reward based pseudo outer product neural fuzzy inference system; associative ambiguity correction based neurofuzzy network; benchmark time series dataset; cellular mechanisms; electrical stimulation; esophageal nerve; feeding motor circuitry; fuzzy knowledge; linguistic rules; low level fuzzy model interpretability; memory storage; molecular mechanisms; sequential learning algorithm; time variant problem domain; Actuators; Cognition; Generators; Inference algorithms; Neurons; Pragmatics; Vectors; Appetitive reward; Hebbian concomitant learning; fuzzy systems; intrinsic neuronal excitability; neural nets; neuro-fuzzy systems; operant conditioning; synaptic plasticity;
  • fLanguage
    English
  • Journal_Title
    Neural Networks and Learning Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    2162-237X
  • Type

    jour

  • DOI
    10.1109/TNNLS.2011.2178529
  • Filename
    6142109