Title :
Convergence of Min-Sum Message-Passing for Convex Optimization
Author :
Moallemi, Ciamac C. ; Van Roy, Benjamin
Author_Institution :
Grad. Sch. of Bus., Columbia Univ., New York, NY, USA
fDate :
4/1/2010 12:00:00 AM
Abstract :
We establish that the min-sum message-passing algorithm and its asynchronous variants converge for a large class of unconstrained convex optimization problems, generalizing existing results for pairwise quadratic optimization problems. The main sufficient condition is that of scaled diagonal dominance. This condition is similar to known sufficient conditions for asynchronous convergence of other decentralized optimization algorithms, such as coordinate descent and gradient descent.
Keywords :
convex programming; gradient methods; message passing; quadratic programming; coordinate descent; decentralized optimization algorithms; gradient descent; min-sum message-passing convergence; pairwise quadratic optimization problems; unconstrained convex optimization problems; Artificial intelligence; Convergence; Decoding; Engineering management; Optimization methods; Parity check codes; Physics; Signal processing algorithms; Sufficient conditions; Turbo codes; Message-passing algorithms; convex optimization; decentralized optimization;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2010.2040863