Title :
Robot juggling: implementation of memory-based learning
Author :
Schaal, Stefan ; Atkeson, Christopher G.
Author_Institution :
Dept. of Brain & Cognitive Sci., MIT, Cambridge, MA, USA
Abstract :
Issues involved in implementing robot learning for a challenging dynamic task are explored in this article, using a case study from robot juggling. We use a memory-based local modeling approach (locally weighted regression) to represent a learned model of the task to be performed. Statistical tests are given to examine the uncertainty of a model, to optimize its prediction quality, and to deal with noisy and corrupted data. We develop an exploration algorithm that explicitly deals with prediction accuracy requirements during exploration. Using all these ingredients in combination with methods from optimal control, our robot achieves fast real-time learning of the task within 40 to 100 trials.<>
Keywords :
learning systems; nonlinear control systems; optimal control; robots; statistical analysis; exploration algorithm; fast real-time learning; locally weighted regression; memory-based local modeling; optimal control; robot juggling; robot learning; statistical tests; Accuracy; Force control; Linear regression; Mathematical model; Optimal control; Parametric statistics; Predictive models; Robots; Testing; Uncertainty;
Journal_Title :
Control Systems, IEEE