• DocumentCode
    376282
  • Title

    Is reduction in task space a condition for accelerated learning?

  • Author

    Hailu, G. ; Nataraj, C. ; Ashrafiuon, H.

  • Author_Institution
    Villanova Univ., PA, USA
  • Volume
    1
  • fYear
    2001
  • fDate
    2001
  • Firstpage
    628
  • Abstract
    Biasing, once regarded as "cheating" in the machine learning community, is now understood and accepted as a necessary part of learning. However, despite its wide acceptance and recognition, biasing has never been studied as a separate research issue, except by Hailu & Sommer (1999), who made an attempt to shed light on the relationship between the quality of the bias and learning trials. So far, the general view held in biasing a learning system is to look for a bias that maximally collapses the search space. It is well-known, however, that reckless reduction of the search space often leads to sub-optimal learning. Regardless of the final level of optimality, this paper challenges this broadily accepted biasing scheme from the point of view of accelerating the learning process itself. Is a large search space a definitive indication of slow learning? We give a non-affirmative answer to this dogma by presenting a typical robot learning scenario. Experiments clearly indicate that, in spite of its large search space, a bias that is derived from the unique characteristics of the task shows better learning behavior than a bias that reduces the search space aggressively
  • Keywords
    learning (artificial intelligence); search problems; Q-learning; accelerated learning; biasing scheme; learning behavior; maximal search space collapse; reinforcement learning; robot learning scenario; search space reduction; sub-optimal learning; task space reduction; unique task characteristics; Acceleration; Learning systems; Machine learning; Machine learning algorithms; Neural networks; Orbital robotics; Robot sensing systems; Space exploration; State-space methods; Time factors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Systems, Man, and Cybernetics, 2001 IEEE International Conference on
  • Conference_Location
    Tucson, AZ
  • ISSN
    1062-922X
  • Print_ISBN
    0-7803-7087-2
  • Type

    conf

  • DOI
    10.1109/ICSMC.2001.969922
  • Filename
    969922