Title :
Opposition-Based Reinforcement Learning in the Management of Water Resources
Author :
Mahootchi, M. ; Tizhoosh, H.R. ; Ponnambalam, K.
Author_Institution :
Syst. Design Eng., Waterloo Univ., Ont.
Abstract :
Opposition-based learning (OBL) is a new scheme in machine intelligence. In this paper, an OBL version Q-learning which exploits opposite quantities to accelerate the learning is used for management of single reservoir operations. In this method, an agent takes an action, receives reward, and updates its knowledge in terms of action-value functions. Furthermore, the transition function which is the balance equation in the optimization model determines the next state and updates the action-value function pertinent to opposite action. Two type of opposite actions will be defined. It will be demonstrated that using OBL can significantly improve the efficiency of the operating policy within limited iterations. It is also shown that this technique is more robust than Q-Learning
Keywords :
environmental science computing; learning (artificial intelligence); optimisation; reservoirs; Q-learning; action-value functions; balance equation; machine intelligence; opposite action; opposition-based reinforcement learning; optimization model; reservoir operation management; transition function; water reservoirs; water resourcemanagement; Design engineering; Dynamic programming; Machine intelligence; Machine learning; Neural networks; Reservoirs; Resource management; Stochastic processes; Systems engineering and theory; Water resources; Q-learning; opposite action; reinforcement learning; water reservoirs;
Conference_Titel :
Approximate Dynamic Programming and Reinforcement Learning, 2007. ADPRL 2007. IEEE International Symposium on
Conference_Location :
Honolulu, HI
Print_ISBN :
1-4244-0706-0
DOI :
10.1109/ADPRL.2007.368191