DocumentCode
728494
Title
Learning without recall in directed circles and rooted trees
Author
Rahimian, Mohammad Amin ; Jadbabaie, Ali
Author_Institution
Dept. of Electr. & Syst. Eng., Univ. of Pennsylvania, Philadelphia, PA, USA
fYear
2015
fDate
1-3 July 2015
Firstpage
4222
Lastpage
4227
Abstract
This work investigates the case of a network of agents that attempt to learn some unknown state of the world amongst the finitely many possibilities. At each time step, agents all receive random, independently distributed private signals whose distributions are dependent on the unknown state of the world. However, it may be the case that some or any of the agents cannot distinguish between two or more of the possible states based only on their private observations, as when several states result in the same distribution of the private signals. In our model, the agents form some initial belief (probability distribution) about the unknown state and then refine their beliefs in accordance with their private observations, as well as the beliefs of their neighbors. An agent learns the unknown state when her belief converges to a point mass that is concentrated at the true state. A rational agent would use the Bayes´ rule to incorporate her neighbors´ beliefs and own private signals over time. While such repeated applications of the Bayes´ rule in networks can become computationally intractable; in this paper, we show that in the canonical cases of directed star, circle or path networks and their combinations, one can derive a class of memoryless update rules that replicate that of a single Bayesian agent but replace the self beliefs with the beliefs of the neighbors. This way, one can realize an exponentially fast rate of learning similar to the case of Bayesian (fully rational) agents. The proposed rules are a special case of the Learning without Recall approach that we develop in a companion paper, and it has the advantage that while preserving essential features of the Bayesian inference, they are made tractable. In particular, the agents can rely on the observational abilities of their neighbors and their neighbors´ neighbors etc. to learn the unknown state; even though they themselves cannot distinguish the truth.
Keywords
Bayes methods; belief networks; inference mechanisms; learning (artificial intelligence); multi-agent systems; statistical distributions; trees (mathematics); Bayes rule; Bayesian fully rational agents; Bayesian inference; circle network; directed circles; directed star; memoryless update rules; path network; point mass; private observations; probability distribution; random independently distributed private signals; rooted trees; single Bayesian agent; true state; unknown state; Bayes methods; Convergence; Probability distribution; Random variables; Silicon; Social network services; Upper bound;
fLanguage
English
Publisher
ieee
Conference_Titel
American Control Conference (ACC), 2015
Conference_Location
Chicago, IL
Print_ISBN
978-1-4799-8685-9
Type
conf
DOI
10.1109/ACC.2015.7171992
Filename
7171992
Link To Document