• DocumentCode
    425230
  • Title

    Robot behavioral selection using discrete event language measure

  • Author

    Wang, Xi ; Fu, Jinbo ; Lee, Peter ; Ray, Asok

  • Author_Institution
    Dept. of Mech. Eng., Pennsylvania State Univ., University Park, PA, USA
  • Volume
    6
  • fYear
    2004
  • fDate
    June 30 2004-July 2 2004
  • Firstpage
    5126
  • Abstract
    This paper proposes a robot behavioral /spl mu/-selection method that maximizes a quantitative measure of languages in the discrete-event setting. This approach complements Q-learning (also called reinforcement learning) that has been widely used in behavioral robotics to learn primitive behaviors. While /spl mu/-selection assigns positive and negative weights to the marked states of a deterministic finite-state automaton (DFSA) model of robot operations, Q-learning assigns reward/penalty on each transition. While the complexity of Q-learning increases exponentially in the number of states and actions, complexity of /spl mu/-selection is polynomial in the number of DFSA states. The paper also presents results of simulation experiments for a robotic scenario to demonstrate the efficacy of the /spl mu/-selection method.
  • Keywords
    computational complexity; control system synthesis; deterministic automata; discrete event systems; finite state machines; formal languages; learning (artificial intelligence); mobile robots; Q-learning; computational complexity; deterministic finite state automaton model; discrete event language; mobile robot behavioral mu selection method; reinforcement learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    American Control Conference, 2004. Proceedings of the 2004
  • Conference_Location
    Boston, MA, USA
  • ISSN
    0743-1619
  • Print_ISBN
    0-7803-8335-4
  • Type

    conf

  • Filename
    1384665