Title :
Distributed Alternating Direction Method of Multipliers
Author :
Ermin Wei ; Ozdaglar, Asuman
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Massachusetts Inst. of Technol., Cambridge, MA, USA
Abstract :
We consider a network of agents that are cooperatively solving a global unconstrained optimization problem, where the objective function is the sum of privately known local objective functions of the agents. Recent literature on distributed optimization methods for solving this problem focused on subgradient based methods, which typically converge at the rate O (1/√k), where k is the number of iterations. In this paper, k we introduce a new distributed optimization algorithm based on Alternating Direction Method of Multipliers (ADMM), which is a classical method for sequentially decomposing optimization problems with coupled constraints. We show that this algorithm converges at the rate O (1/k).
Keywords :
gradient methods; learning (artificial intelligence); matrix multiplication; multi-agent systems; optimisation; ADMM; alternating direction method of multipliers; distributed alternating direction method; distributed optimization algorithm; distributed optimization methods; global unconstrained optimization problem; privately known local objective functions; sequentially decomposing optimization problems; subgradient based methods; Algorithm design and analysis; Convergence; Cost function; Lagrangian functions; Standards; Vectors;
Conference_Titel :
Decision and Control (CDC), 2012 IEEE 51st Annual Conference on
Conference_Location :
Maui, HI
Print_ISBN :
978-1-4673-2065-8
Electronic_ISBN :
0743-1546
DOI :
10.1109/CDC.2012.6425904