Title :
Improving reinforcement learning algorithms for dynamic spectrum allocation in cognitive sensor networks
Author :
Faganello, Leonardo Roveda ; Kunst, Rafael ; Both, Cristiano Bonato ; Granville, Lisandro Z. ; Rochol, Juergen
Abstract :
Cognitive Radio Networks enable a higher number of users to access the spectrum of frequency simultaneously. This access is possible due to the implementation of dynamic spectrum allocation algorithms. In this context, one of the main algorithms found in the literature is the reinforcement learning based approach called Q-Learning. Although been widely applied, this algorithm does not take into account accurate information about the behavior of users neither the channel propagation conditions. In this sense, we propose three improvements to the dynamic spectrum allocation algorithms based on reinforcement learning for cognitive sensor networks. Simulation results show that all the proposed algorithms allow allocating channels with up to 6dB better quality and 4% higher efficiency than Q-Learning.
Keywords :
channel allocation; cognitive radio; learning (artificial intelligence); radio networks; radio spectrum management; telecommunication computing; Q-Learning; channel allocation; channel propagation condition; cognitive radio networks; cognitive sensor networks; dynamic spectrum allocation algorithm; reinforcement learning algorithm; spectrum access; Heuristic algorithms; Interference; Mathematical model; Resource management; Signal to noise ratio; Wireless communication; Wireless sensor networks;
Conference_Titel :
Wireless Communications and Networking Conference (WCNC), 2013 IEEE
Conference_Location :
Shanghai
Print_ISBN :
978-1-4673-5938-2
Electronic_ISBN :
1525-3511
DOI :
10.1109/WCNC.2013.6554535