Title :
Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access
Author :
Cohen, Kobi ; Qing Zhao ; Scaglione, Anna
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of California, Davis, Davis, CA, USA
Abstract :
We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.
Keywords :
Markov processes; cognitive radio; radio access networks; radio spectrum management; signal detection; time-varying channels; RMAB problem; channel occupancy dynamics; cognitive user; dynamic spectrum access problem; myopic policy optimality; restless multiarmed bandit problem; time-varying activation constraints; Cascading style sheets; Compressed sensing; Conferences; Dynamic spectrum access; Frequency selective surfaces; Indexes; Sensors;
Conference_Titel :
Signals, Systems and Computers, 2014 48th Asilomar Conference on
Print_ISBN :
978-1-4799-8295-0
DOI :
10.1109/ACSSC.2014.7094730
