DocumentCode
1852693
Title
Application of reinforcement learning control to a nonlinear dexterous robot
Author
Bucak, Ihsan Omur ; Zohdy, Mohamed A.
Author_Institution
Sch. of Eng. & Comput. Sci., Oakland Univ., Rochester, MI, USA
Volume
5
fYear
1999
fDate
1999
Firstpage
5108
Abstract
In this paper, the effects of basic parameters in reinforcement learning control such as eligibility, action and critic network weights, system nonlinearities, gradient information, state-space partitioning, variance of exploration were studied in detail. We attempt to increase feasibility for practical applications, implementation, learning efficiency, and performance. Reinforcement learning is then applied for control of a nonlinear dexterous robot. This control problem dictates that the learning is performed online, based on binary and real valued reinforcement signal from a critic network, without knowing the system model nonlinearity. The learning algorithm consists of an action and critic networks that learn to keep the multifinger hand of the dexterous robot within desired limits
Keywords
control nonlinearities; dexterous manipulators; learning (artificial intelligence); nonlinear control systems; state-space methods; critic networks; multifinger hand; nonlinear dexterous robot; nonlinearities; reinforcement learning; state-space partitioning; Application software; Backpropagation algorithms; Computer science; Control systems; Electronic mail; Neural networks; Nonlinear control systems; Robots; Supervised learning; Systems engineering and theory;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control, 1999. Proceedings of the 38th IEEE Conference on
Conference_Location
Phoenix, AZ
ISSN
0191-2216
Print_ISBN
0-7803-5250-5
Type
conf
DOI
10.1109/CDC.1999.833361
Filename
833361
Link To Document