Title :
Convergence rates for cooperation in heterogeneous populations
Author :
Bean, A. ; Kairouz, Peter ; Singer, Amit
Author_Institution :
Univ. of Illinois at Urbana Champaign, Champaign, IL, USA
Abstract :
We consider the problem of cooperative distributed estimation within a network of heterogeneous agents. In particular, we study the situation where each agent observes an independent stream of Bernoulli random variables, and the goal is for each to determine its own Bernoulli parameter. The agents of this population can be categorized into a small number of subgroups, where within each group the agents all have identical Bernoulli parameters. For a distributed algorithm based on consensus strategies, we examine the rate at which the agent´s estimates converge to the correct values. We show that the expected squared error decreases nearly as fast as centralized ML estimation in a homogeneous population. In a heterogeneous population, we derive an approximation to the expected squared error, as a function of the number of observations. Finally, we present simulation results that compare the predicted expected squared error to that observed in the simulations.
Keywords :
convergence; distributed algorithms; least squares approximations; maximum likelihood estimation; random processes; signal processing; Bernoulli parameter; Bernoulli random variable; centralized ML estimation; consensus strategy; convergence rate; cooperative distributed estimation; distributed algorithm; distributed signal processing; gossip algorithm; heterogeneous agent network; heterogeneous population; homogeneous population; population agent; squared error approximation; adaptation; consensus; diffusion; distributed estimation; distributed signal processing; gossip algorithms;
Conference_Titel :
Signals, Systems and Computers (ASILOMAR), 2012 Conference Record of the Forty Sixth Asilomar Conference on
Conference_Location :
Pacific Grove, CA
Print_ISBN :
978-1-4673-5050-1
DOI :
10.1109/ACSSC.2012.6489061