Title :
Dynamic power control in Wireless Body Area Networks using reinforcement learning with approximation
Author :
Kazemi, Ramtin ; Vesilo, Rein ; Dutkiewicz, Eryk ; Liu, Ren
Author_Institution :
Dept. of Electron. Eng., Macquarie Univ., Sydney, NSW, Australia
Abstract :
A Wireless Body Area Network (WBAN) is made up of multiple tiny physiological sensors implanted in/on the human body with each sensor equipped with a wireless transceiver that communicates to a coordinator in a star topology. Energy is the scarcest resource in WBANs. Power control mechanisms to achieve a certain level of utility while using as little power for transmission as possible can play an important role in reducing energy consumption in such very energy-constrained networks. In this paper, we propose a novel power controller to mitigate internetwork interference in WBANs and increase the maximum achievable throughput with the minimum energy consumption. The proposed power controller employs reinforcement learning with approximation to learn from the environment and improve its performance. We compare the performance of the proposed controller to two other power controllers, one based on game theory and the other one based on fuzzy logic. Simulation results show that compared to the other two approaches, RLPC provides a substantial saving in energy consumption per bit, with a substantial increase in network lifetime.
Keywords :
approximation theory; body area networks; control engineering computing; fuzzy control; game theory; interference suppression; learning (artificial intelligence); power control; radio transceivers; telecommunication control; telecommunication network reliability; WBAN; approximation; dynamic power control; energy consumption reduction; energy-constrained networks; fuzzy logic; game theory; interference mitigation; network lifetime; physiological sensors; reinforcement learning; wireless body area networks; wireless transceiver; Approximation methods; Energy consumption; Interference; Power control; Sensors; Throughput; Wireless sensor networks; Dynamic Power Control; Fuzzy Logic; Game Theory; Interference; Reinforcement Learning; WBAN;
Conference_Titel :
Personal Indoor and Mobile Radio Communications (PIMRC), 2011 IEEE 22nd International Symposium on
Conference_Location :
Toronto, ON
Print_ISBN :
978-1-4577-1346-0
Electronic_ISBN :
pending
DOI :
10.1109/PIMRC.2011.6139908