DocumentCode
2570133
Title
Aspiration learning in coordination games
Author
Chasparis, Georgios C. ; Shamma, Jeff S. ; Arapostathis, Ari
Author_Institution
Sch. of Electr. & Comput. Eng., Georgia Inst. of Technol., Atlanta, GA, USA
fYear
2010
fDate
15-17 Dec. 2010
Firstpage
5756
Lastpage
5761
Abstract
We consider the problem of distributed convergence to efficient outcomes in coordination games through payoff-based learning dynamics, namely aspiration learning. The proposed learning scheme assumes that players reinforce well performed actions, by successively playing these actions, otherwise they randomize among alternative actions. Our first contribution is the characterization of the asymptotic behavior of the induced Markov chain of the iterated process by an equivalent finite-state Markov chain, which simplifies previously introduced analysis on aspiration learning. We then characterize explicitly the behavior of the proposed aspiration learning in a generalized version of so-called coordination games, an example of which is network formation games. In particular, we show that in coordination games the expected percentage of time that the efficient action profile is played can become arbitrarily large.
Keywords
Markov processes; convergence; game theory; iterative methods; learning (artificial intelligence); aspiration learning; asymptotic behavior; coordination games; distributed convergence; equivalent finite-state Markov chain; induced Markov chain; iterated process; learning scheme; network formation games; payoff-based learning dynamics; well performed actions; Convergence; Gallium; Games; Limiting; Markov processes; Nash equilibrium; Topology;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control (CDC), 2010 49th IEEE Conference on
Conference_Location
Atlanta, GA
ISSN
0743-1546
Print_ISBN
978-1-4244-7745-6
Type
conf
DOI
10.1109/CDC.2010.5717289
Filename
5717289
Link To Document