Title :
Burst-level congestion control using hindsight optimization
Author :
Wu, Gang ; Chong, Edwin K P ; Givan, Robert
Author_Institution :
Sch. of Electr. & Comput. Eng., Purdue Univ., West Lafayette, IN, USA
fDate :
6/1/2002 12:00:00 AM
Abstract :
We consider the burst-level congestion-control problem in a communication network with multiple traffic sources, each modeled as a fully controllable stream of fluid traffic. The controlled traffic shares a common bottleneck node with high-priority cross traffic described by a Markov-modulated fluid (MMF). Each controlled source is assumed to have a unique round-trip delay. The goal is to maximize a linear combination of the throughput, delay, traffic-loss rate, and a fairness metric at the bottleneck node. We introduce a simulation-based congestion-control scheme capable of performing effectively under rapidly varying cross traffic by making use of the provided MMF model of that variation. The control problem is posed as a finite-horizon Markov decision process, and is solved heuristically using a technique called hindsight optimization. We provide a detailed derivation of our congestion-control algorithm based on this technique. Our empirical study shows that the control scheme performs significantly better than the conventional proportional-derivative congestion-control method
Keywords :
Markov processes; optimisation; telecommunication congestion control; telecommunication network management; Markov decision processes; Markov-modulated fluid; bottleneck node; communication networks; congestion control; delay; hindsight optimization; online simulation; throughput; traffic models; Asynchronous transfer mode; Communication system control; Communication system traffic control; Delay; Linear feedback control systems; Optimal control; PD control; Proportional control; Protocols; Traffic control;
Journal_Title :
Automatic Control, IEEE Transactions on
DOI :
10.1109/TAC.2002.1008362