Title :
Adaptive Opportunistic Routing for Wireless Ad Hoc Networks
Author :
Bhorkar, Abhijeet A. ; Naghshvar, Mohammad ; Javidi, Tara ; Rao, Bhaskar D.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of California San Diego, La Jolla, CA, USA
Abstract :
A distributed adaptive opportunistic routing scheme for multihop wireless ad hoc networks is proposed. The proposed scheme utilizes a reinforcement learning framework to opportunistically route the packets even in the absence of reliable knowledge about channel statistics and network model. This scheme is shown to be optimal with respect to an expected average per-packet reward criterion. The proposed routing scheme jointly addresses the issues of learning and routing in an opportunistic context, where the network structure is characterized by the transmission success probabilities. In particular, this learning framework leads to a stochastic routing scheme that optimally “explores” and “exploits” the opportunities in the network.
Keywords :
ad hoc networks; learning (artificial intelligence); stochastic processes; telecommunication computing; telecommunication network routing; wireless channels; channel statistics; distributed adaptive opportunistic routing scheme; multihop wireless ad hoc networks; network model; per-packet reward criterion; reinforcement learning framework; stochastic routing scheme; transmission success probability; Ad hoc networks; Delay; Knowledge engineering; Markov processes; Relays; Routing; Wireless communication; Opportunistic routing; reward maximization; wireless ad hoc networks;
Journal_Title :
Networking, IEEE/ACM Transactions on
DOI :
10.1109/TNET.2011.2159844