Title :
Cooperative retransmissions using Markov decision process with reinforcement learning
Author :
Shirazi, Ghasem Naddafzadeh ; Kong, Peng-Yong ; Tham, Chen-Khong
Author_Institution :
Inst. for Infocomm Res., Agency for Sci., Technol. & Res. (A*STAR), Singapore, Singapore
Abstract :
In cooperative retransmissions, nodes with better channel qualities help other nodes in retransmitting a failed packet to its intended destination. In this paper, we propose a cooperative retransmission scheme where each node makes local decision to cooperate or not to cooperate at what transmission power using a Markov decision process with reinforcement learning. With the reinforcement learning, the proposed scheme avoids solving an Markov decision process with a large number of states. Through simulations, we show that the proposed scheme is robust to collisions, is scalable with regard to the network size, and can provide significant cooperative diversity.
Keywords :
Markov processes; diversity reception; wireless channels; Markov decision process; cooperative diversity; cooperative retransmission; reinforcement learning; Automatic repeat request; Bismuth; Dynamic programming; Learning; Poles and towers; Relays; Robustness; Throughput; Transmitters; Wireless networks;
Conference_Titel :
Personal, Indoor and Mobile Radio Communications, 2009 IEEE 20th International Symposium on
Conference_Location :
Tokyo
Print_ISBN :
978-1-4244-5122-7
Electronic_ISBN :
978-1-4244-5123-4
DOI :
10.1109/PIMRC.2009.5450098