• DocumentCode
    728494
  • Title

    Learning without recall in directed circles and rooted trees

  • Author

    Rahimian, Mohammad Amin ; Jadbabaie, Ali

  • Author_Institution
    Dept. of Electr. & Syst. Eng., Univ. of Pennsylvania, Philadelphia, PA, USA
  • fYear
    2015
  • fDate
    1-3 July 2015
  • Firstpage
    4222
  • Lastpage
    4227
  • Abstract
    This work investigates the case of a network of agents that attempt to learn some unknown state of the world amongst the finitely many possibilities. At each time step, agents all receive random, independently distributed private signals whose distributions are dependent on the unknown state of the world. However, it may be the case that some or any of the agents cannot distinguish between two or more of the possible states based only on their private observations, as when several states result in the same distribution of the private signals. In our model, the agents form some initial belief (probability distribution) about the unknown state and then refine their beliefs in accordance with their private observations, as well as the beliefs of their neighbors. An agent learns the unknown state when her belief converges to a point mass that is concentrated at the true state. A rational agent would use the Bayes´ rule to incorporate her neighbors´ beliefs and own private signals over time. While such repeated applications of the Bayes´ rule in networks can become computationally intractable; in this paper, we show that in the canonical cases of directed star, circle or path networks and their combinations, one can derive a class of memoryless update rules that replicate that of a single Bayesian agent but replace the self beliefs with the beliefs of the neighbors. This way, one can realize an exponentially fast rate of learning similar to the case of Bayesian (fully rational) agents. The proposed rules are a special case of the Learning without Recall approach that we develop in a companion paper, and it has the advantage that while preserving essential features of the Bayesian inference, they are made tractable. In particular, the agents can rely on the observational abilities of their neighbors and their neighbors´ neighbors etc. to learn the unknown state; even though they themselves cannot distinguish the truth.
  • Keywords
    Bayes methods; belief networks; inference mechanisms; learning (artificial intelligence); multi-agent systems; statistical distributions; trees (mathematics); Bayes rule; Bayesian fully rational agents; Bayesian inference; circle network; directed circles; directed star; memoryless update rules; path network; point mass; private observations; probability distribution; random independently distributed private signals; rooted trees; single Bayesian agent; true state; unknown state; Bayes methods; Convergence; Probability distribution; Random variables; Silicon; Social network services; Upper bound;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    American Control Conference (ACC), 2015
  • Conference_Location
    Chicago, IL
  • Print_ISBN
    978-1-4799-8685-9
  • Type

    conf

  • DOI
    10.1109/ACC.2015.7171992
  • Filename
    7171992