Title :
Fuzzy Q-learning flow control for high-speed networks
Author :
Li, Xin ; Zhao, Xin ; Jing, Yuanwei ; Zhang, Nannan
Author_Institution :
Coll. of Inf. Sci. & Eng., Northeastern Univ., Shenyang
Abstract :
For the congestion problems in high-speed networks, a flow controller based on fuzzy Q-learning is proposed. Because of the uncertainties and highly time-varying, it is not easy to accurately obtain the complete information for high-speed networks. The Q-learning algorithm, which is independent of mathematic model, improves its behavior policy through interaction with the environment. The fuzzy inference is introduced to facilitate generalization in the state space. By means of learning procedures, the proposed controller can learn to take the best action to regulate source flow with the features of high throughput and low packet loss ratio. Simulation results show that the proposed method can promote the performance of the networks and avoid the occurrence of congestion effectively.
Keywords :
fuzzy set theory; learning (artificial intelligence); telecommunication congestion control; time-varying systems; flow controller; fuzzy Q-learning flow control; high-speed networks; low packet loss ratio; mathematic model; Fuzzy control; High-speed networks; Flow control; High-speed network; Q-learning; fuzzy logic;
Conference_Titel :
Control and Decision Conference, 2008. CCDC 2008. Chinese
Conference_Location :
Yantai, Shandong
Print_ISBN :
978-1-4244-1733-9
Electronic_ISBN :
978-1-4244-1734-6
DOI :
10.1109/CCDC.2008.4597335