Title :
Efficient dynamic programming for high-dimensional, optimal motion planning by spectral learning of approximate value function symmetries
Author :
Vernaza, Paul ; Lee, Daniel D.
Author_Institution :
GRASP Lab., Univ. of Pennsylvania, Philadelphia, PA, USA
Abstract :
We demonstrate how to find high-quality motion plans for high-dimensional holonomic systems efficiently using dynamic programming in a learned subspace of vastly reduced dimension. Our approach (SLASHDP) learns the low dimensional cost structure of an optimal control problem via an efficient spectral method. This structure results in a symmetric value function that serves as a an efficiently-computable surrogate for the true value function. High-quality feedback motion plans can then be obtained from the symmetric value function. Experimental results show that SLASHDP yields higher-quality plans than can be obtained by post-processing plans generated by a sampling-based motion planner, and with less computational effort for very high-dimensional problems. We demonstrate high-quality dynamic programming plans for an arm planning problem of up to 144 dimensions without using any domain-specific knowledge aside from that learned automatically by SLASHDP. Positive results are also shown for a high-dimensional deformable robot planning problem.
Keywords :
approximation theory; deformation; dynamic programming; feedback; learning (artificial intelligence); mobile robots; optimal control; path planning; sampling methods; SLASHDP approach; approximate value function symmetry; dynamic programming; high-dimensional deformable robot planning problem; high-dimensional holonomic system; high-dimensional optimal motion planning; high-quality feedback motion planning; low-dimensional cost structure; optimal control problem; post-processing planning; sampling-based motion planner; spectral learning; true value function; Approximation methods; Cost function; Dynamic programming; Eigenvalues and eigenfunctions; Joints; Planning; Robots;
Conference_Titel :
Robotics and Automation (ICRA), 2011 IEEE International Conference on
Conference_Location :
Shanghai
Print_ISBN :
978-1-61284-386-5
DOI :
10.1109/ICRA.2011.5980552