Title :
Q-learning based adaptive subgraph generation algorithm for graph routing in ISA 100.11a
Author :
Khan, Faisal I. ; Ki-Hyung Kim
Author_Institution :
Grad. Sch. of Comput. Eng., Ajou Univ., Suwon, South Korea
Abstract :
Graph routing is a routing protocol opted to run in ISA 100.11a based networks. Attention towards proposing a time efficient subgraph is received by the researchers. While there can be a lot of network performance level factors considered to generate subgraphs for efficient and timely delivery of data. ISA 100.11a specification doesn´t specifies a graph generation algorithm to generate subgraphs for a network. Hence, numerous efforts can be found where the research community has taken initiative in proposing subgraphs considering factors affecting the performance of the network. Subgraphs which are optimal at a particular instance of time may not prove to be effective after a certain time period. Therefore, there is a need to update the subgraphs in the network based on the history of the network performance parameters accumulated over a certain time period which will not necessarily regenerate the subgraphs in the network based on the history will penalize the subgraphs which degrade the performance of the applications using the subgraph. Q-learning mechanism is a lightweight mechanism which works on the idea of rewarding an action considered good for environment. We propose an idea of generating subgraphs after a time period based on Q-learning mechanism.
Keywords :
graph theory; learning (artificial intelligence); performance evaluation; routing protocols; telecommunication computing; telecommunication standards; ISA 100.11a based network; Q-learning based adaptive subgraph generation algorithm; graph routing; lightweight Q-learning mechanism; network performance level factors; network performance parameters; routing protocol; Graph routing; ISA 100.11a; Machine learning in Wireless Sensor Networks; Q-learning; Routing security; Subgraph generation algorithm;
Conference_Titel :
ICT Convergence (ICTC), 2013 International Conference on
Conference_Location :
Jeju
DOI :
10.1109/ICTC.2013.6675567