DocumentCode :
728494
Title :
Learning without recall in directed circles and rooted trees
Author :
Rahimian, Mohammad Amin ; Jadbabaie, Ali
Author_Institution :
Dept. of Electr. & Syst. Eng., Univ. of Pennsylvania, Philadelphia, PA, USA
fYear :
2015
fDate :
1-3 July 2015
Firstpage :
4222
Lastpage :
4227
Abstract :
This work investigates the case of a network of agents that attempt to learn some unknown state of the world amongst the finitely many possibilities. At each time step, agents all receive random, independently distributed private signals whose distributions are dependent on the unknown state of the world. However, it may be the case that some or any of the agents cannot distinguish between two or more of the possible states based only on their private observations, as when several states result in the same distribution of the private signals. In our model, the agents form some initial belief (probability distribution) about the unknown state and then refine their beliefs in accordance with their private observations, as well as the beliefs of their neighbors. An agent learns the unknown state when her belief converges to a point mass that is concentrated at the true state. A rational agent would use the Bayes´ rule to incorporate her neighbors´ beliefs and own private signals over time. While such repeated applications of the Bayes´ rule in networks can become computationally intractable; in this paper, we show that in the canonical cases of directed star, circle or path networks and their combinations, one can derive a class of memoryless update rules that replicate that of a single Bayesian agent but replace the self beliefs with the beliefs of the neighbors. This way, one can realize an exponentially fast rate of learning similar to the case of Bayesian (fully rational) agents. The proposed rules are a special case of the Learning without Recall approach that we develop in a companion paper, and it has the advantage that while preserving essential features of the Bayesian inference, they are made tractable. In particular, the agents can rely on the observational abilities of their neighbors and their neighbors´ neighbors etc. to learn the unknown state; even though they themselves cannot distinguish the truth.
Keywords :
Bayes methods; belief networks; inference mechanisms; learning (artificial intelligence); multi-agent systems; statistical distributions; trees (mathematics); Bayes rule; Bayesian fully rational agents; Bayesian inference; circle network; directed circles; directed star; memoryless update rules; path network; point mass; private observations; probability distribution; random independently distributed private signals; rooted trees; single Bayesian agent; true state; unknown state; Bayes methods; Convergence; Probability distribution; Random variables; Silicon; Social network services; Upper bound;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
American Control Conference (ACC), 2015
Conference_Location :
Chicago, IL
Print_ISBN :
978-1-4799-8685-9
Type :
conf
DOI :
10.1109/ACC.2015.7171992
Filename :
7171992
Link To Document :
بازگشت