DocumentCode :
2818953
Title :
Solving sensor network coverage problems by distributed asynchronous actor-critic methods
Author :
Pennesi, Paris ; Paschalidis, Ioannis Ch
Author_Institution :
Univ. Polytech. delle Marche, Ancona
fYear :
2007
fDate :
12-14 Dec. 2007
Firstpage :
5300
Lastpage :
5305
Abstract :
Multi-robots systems exploiting sensor network capabilities can be successfully employed to cope with several tasks, including coverage, surveillance, target tracking, and foraging, in partially known environments subject to dynamical changes. In this paper we define a reward collection problem, where both the positions and the values of the rewards change with time. We propose a distributed actor-critic method to solve the problem, establish its convergence, and demonstrate its adaptation capabilities. Our analysis leverages ideas from actor-critic methods and consensus algorithms.
Keywords :
adaptive systems; distributed control; dynamic programming; multi-robot systems; optimal control; adaptation capability; consensus algorithm; distributed asynchronous actor-critic methods; dynamic programming; foraging; multirobot system; optimal control; reward collection problem; sensor network coverage problem; surveillance; target tracking; Algorithm design and analysis; Computer aided manufacturing; Convergence; Distributed control; Multirobot systems; Robot sensing systems; Sensor systems; Space missions; Surveillance; Target tracking; Actor-critic methods; consensus algorithms; dynamic programming; sensor networks;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Decision and Control, 2007 46th IEEE Conference on
Conference_Location :
New Orleans, LA
ISSN :
0191-2216
Print_ISBN :
978-1-4244-1497-0
Electronic_ISBN :
0191-2216
Type :
conf
DOI :
10.1109/CDC.2007.4434277
Filename :
4434277
Link To Document :
بازگشت