Title :
Performance Evaluation of the Consensus-Based Distributed Subgradient Method Under Random Communication Topologies
Author :
Matei, Ion ; Baras, John S.
Author_Institution :
Electr. Eng. Dept., Univ. of Maryland, College Park, MD, USA
Abstract :
We investigate collaborative optimization of an objective function expressed as a sum of local convex functions, when the agents make decisions in a distributed manner using local information, while the communication topology used to exchange messages and information is modeled by a graph-valued random process, assumed independent and identically distributed. Specifically, we study the performance of the consensus-based multi-agent distributed subgradient method and show how it depends on the probability distribution of the random graph. For the case of a constant stepsize, we first give an upper bound on the difference between the objective function, evaluated at the agents´ estimates of the optimal decision vector, and the optimal value. Second, for a particular class of convex functions, we give an upper bound on the distances between the agents´ estimates of the optimal decision vector and the minimizer. In addition, we provide the rate of convergence to zero of the time varying component of the aforementioned upper bound. The addressed metrics are evaluated via their expected values. As an application, we show how the distributed optimization algorithm can be used to perform collaborative system identification and provide numerical experiments under the randomized and broadcast gossip protocols.
Keywords :
convex programming; distributed algorithms; gradient methods; graph theory; groupware; message passing; multi-agent systems; performance evaluation; protocols; random processes; addressed metrics; aforementioned upper bound; agents estimates; broadcast gossip protocols; collaborative optimization; collaborative system identification; consensus-based distributed subgradient method; consensus-based multiagent distributed subgradient method; constant stepsize; convergence rate; distributed manner; distributed optimization algorithm; exchange information; exchange messages; graph-valued random process; local convex functions; local information; objective function; optimal decision vector; optimal value; performance evaluation; probability distribution; random communication topology; random graph; randomized gossip protocols; time varying component; Convex functions; Measurement; Optimization; Probability distribution; Protocols; Topology; Upper bound; Distributed; stochastic systems; sub-gradient methods; system identification;
Journal_Title :
Selected Topics in Signal Processing, IEEE Journal of
DOI :
10.1109/JSTSP.2011.2120593