DocumentCode
2947766
Title
Oblivious equilibrium for stochastic games with concave utility
Author
Adlakha, Sachin ; Johari, Ramesh ; Weintraub, Gabriel ; Goldsmith, Andrea
Author_Institution
Dept. of Electr. Eng., Stanford Univ., Stanford, CA
fYear
2008
fDate
23-26 Sept. 2008
Firstpage
1304
Lastpage
1308
Abstract
We study stochastic games with a large number of players, where players are coupled via their payoff functions. A standard solution concept for stochastic games is Markov perfect equilibrium (MPE). In MPE, each player´s strategy is a function of its own state as well as the state of other players. This makes MPE computationally prohibitive as the number of players becomes large. An approximate solution concept called oblivious equilibrium (OE) was introduced by Weintraub et al., where each player´s decision depends only on its own state and the ldquolong-run averagerdquo state of other players. This makes OE computationally more tractable than MPE. It was shown that under a set of assumptions, as the number of players becomes large, OE closely approximates MPE. However, these assumptions require the computation of OE and verifying that the resulting stationary distribution satisfies a certain light-tail condition. In this paper, we derive exogenous conditions on the state dynamics and the payoff function under which the light-tail condition holds. A key condition is that the agents´ payoffs are concave in their own state and actions. These exogenous conditions enable us to characterize a family of stochastic games in which OE is a good approximation for MPE.
Keywords
Markov processes; game theory; Markov perfect equilibrium; oblivious equilibrium; stochastic games; Algorithm design and analysis; Distributed computing; Dynamic programming; Heuristic algorithms; History; Large-scale systems; State-space methods; Statistics; Stochastic processes; Systems engineering and theory;
fLanguage
English
Publisher
ieee
Conference_Titel
Communication, Control, and Computing, 2008 46th Annual Allerton Conference on
Conference_Location
Urbana-Champaign, IL
Print_ISBN
978-1-4244-2925-7
Electronic_ISBN
978-1-4244-2926-4
Type
conf
DOI
10.1109/ALLERTON.2008.4797711
Filename
4797711
Link To Document