Title :
Multichannel non-persistent CSMA MAC schemes with reinforcement learning for cognitive radio networks
Author :
Tang, Yi ; Grace, David ; Clarke, Tim ; Wei, Jibo
Author_Institution :
Sch. of Electron. Sci. & Eng., Nat. Univ. of Defense Technol., Changsha, China
Abstract :
This paper presents two multichannel non-persistent CSMA (M-np-CSMA) MAC schemes using Simple Reinforcement Learning and State-Action-Reward-State-Action (SARSA) learning respectively for distributed cognitive radio networks. The two learning schemes both use reinforcement learning to help the users learn the environment and historical transmissions. Compared with M-np-CSMA MAC protocol with random channel choice, the learning schemes can help the cognitive users choose the best channels which offer more spectrum access opportunities to sense and access. The results show that both learning schemes can effectively improve the throughput and decrease the packet delay at heavy traffic loads and with a large number of cognitive users. The Simple Reinforcement Learning scheme and SARSA scheme can achieves a 15% and 25% improvement in the maximum throughput respectively, compared with the M-np-CSMA without learning.
Keywords :
access protocols; carrier sense multiple access; cognitive radio; learning (artificial intelligence); telecommunication computing; M-np-CSMA MAC protocol; SARSA; cognitive radio networks; cognitive users; historical transmissions; multichannel nonpersistent CSMA MAC; reinforcement learning; state-action-reward-state-action learning; Cognitive radio; Delay; Learning; Multiaccess communication; Protocols; Sensors; Throughput;
Conference_Titel :
Communications and Information Technologies (ISCIT), 2011 11th International Symposium on
Conference_Location :
Hangzhou
Print_ISBN :
978-1-4577-1294-4
DOI :
10.1109/ISCIT.2011.6092159