• DocumentCode
    1681842
  • Title

    A connectionist architecture that adapts its representation to complex tasks

  • Author

    Scherrer, Bruno

  • Author_Institution
    LORIA, Vandoeuvre-les-Nancy, France
  • Volume
    3
  • fYear
    2002
  • fDate
    6/24/1905 12:00:00 AM
  • Firstpage
    2929
  • Lastpage
    2934
  • Abstract
    This paper presents an original connectionist architecture that is capable of adapting its representation to one or various reinforcement problems. We briefly describe the generic reinforcement learning theory that it is based on. We focus on distributed algorithms that enables efficient planning. In this specific framework, we define the notion of task-specialisation and propose a procedure for adapting a task model without increasing its complexity. It consists in a high-level learning of representation in problems with possibly delayed reinforcements. We show that such a single architecture can adapt to multiple tasks. Finally, we stress its connectionist nature: most computations can be distributed and done in parallel. We illustrate and evaluate this adaptation paradigm on a navigation continuous-space environment
  • Keywords
    Markov processes; decision theory; generalisation (artificial intelligence); learning (artificial intelligence); neural net architecture; Markov Decision Process; connectionist architecture; distributed algorithms; generalisation; reinforcement learning; task specialisation; task-specialisation; Artificial intelligence; Biology computing; Computer architecture; Concurrent computing; Decision making; Delay; Distributed algorithms; Intelligent robots; Learning; Stress;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Neural Networks, 2002. IJCNN '02. Proceedings of the 2002 International Joint Conference on
  • Conference_Location
    Honolulu, HI
  • ISSN
    1098-7576
  • Print_ISBN
    0-7803-7278-6
  • Type

    conf

  • DOI
    10.1109/IJCNN.2002.1007614
  • Filename
    1007614