• DocumentCode
    663431
  • Title

    Evaluating techniques for learning a feedback controller for low-cost manipulators

  • Author

    Cliff, Oliver M. ; Sildomar, T. ; Monteiro

  • Author_Institution
    Australian Centre for Field Robot., Univ. of Sydney, Sydney, NSW, Australia
  • fYear
    2013
  • fDate
    3-7 Nov. 2013
  • Firstpage
    704
  • Lastpage
    709
  • Abstract
    Robust manipulation with tractability in unstructured environments is a prominent hurdle in robotics. Learning algorithms to control robotic arms have introduced elegant solutions to the complexities faced in such systems. A novel method of Reinforcement Learning (RL), Gaussian Process Dynamic Programming (GPDP), yields promising results for closed-loop control of a low-cost manipulator however research surrounding most RL techniques lack breadth of comparable experiments into the viability of particular learning techniques on equivalent environments. We introduce several model-based learning agents as mechanisms to control a noisy, low-cost robotic system. The agents were tested in a simulated domain for learning closed-loop policies of a simple task with no prior information. Then, the fidelity of the simulations is confirmed by application of GPDP to a physical system.
  • Keywords
    Gaussian processes; closed loop systems; dynamic programming; feedback; learning (artificial intelligence); manipulators; GPDP; Gaussian process dynamic programming; RL techniques; closed-loop control; closed-loop policy learning; evaluating techniques; feedback controller; low-cost manipulators; model-based learning agents; physical system; reinforcement learning algorithm; robotic arm control; robust manipulation; tractability; unstructured environments; Decision trees; Dynamic programming; Gaussian processes; Joints; Manipulators; Noise;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on
  • Conference_Location
    Tokyo
  • ISSN
    2153-0858
  • Type

    conf

  • DOI
    10.1109/IROS.2013.6696428
  • Filename
    6696428