DocumentCode :
3413962
Title :
Coordinated Sensing Coverage in Sensor Networks using Distributed Reinforcement Learning
Author :
Renaud, Jean-Christophe ; Tham, Chen-Khong
Author_Institution :
Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore
Volume :
1
fYear :
2006
fDate :
Sept. 2006
Firstpage :
1
Lastpage :
6
Abstract :
A multi-agent system (MAS) approach on wireless sensor networks (WSNs) comprising sensor-actuator nodes is very promising as it has the potential to tackle the resource constraints inherent in these networks by efficiently coordinating the activities among the nodes. In this paper, we consider the coordinated sensing coverage problem and study the behavior and performance of four distributed reinforcement learning (DRL) algorithms: (i) fully distributed Q-learning, (ii) distributed value function (DVF), (iii) optimistic DRL, and (iv) frequency maximum Q-Iearning (FMQ). We present results from simulation studies and actual implementation of these DRL algorithms on Crossbow Mica2 motes, and compare their performance in terms of incurred communication and computational costs, energy consumption and the achieved level of sensing coverage. Issues such as convergence to local or global optima, as well as speed of convergence are also considered. These implementation results show that the DVF agents outperform other agents in terms of both convergence and energy consumption
Keywords :
learning (artificial intelligence); wireless sensor networks; DRL algorithms; MAS; WSN; convergence; distributed reinforcement learning; multiagent system; sensing coverage; wireless sensor networks; Algorithm design and analysis; Convergence; Distributed computing; Energy consumption; Intelligent networks; Learning; Multiagent systems; Sensor systems; Stochastic processes; Wireless sensor networks; Coordinated sensing coverage; Distributed reinforcement learning; Multiagent systems; Sensor networks;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Networks, 2006. ICON '06. 14th IEEE International Conference on
Conference_Location :
Singapore
ISSN :
1556-6463
Print_ISBN :
0-7803-9746-0
Type :
conf
DOI :
10.1109/ICON.2006.302580
Filename :
4087680
Link To Document :
بازگشت