Title :
Social norm and long-run learning in peer-to-peer networks
Author :
Zhang, Yu ; Van der Schaar, Mihaela
Author_Institution :
Dept. of Electr. Eng., UCLA, Los Angeles, CA, USA
Abstract :
We start by formulating the resource sharing in peer-to-peer (P2P) networks as a random-matching gift-giving game, where self-interested peers aim at maximizing their own long-term utilities. In order to provide incentives for the peers to voluntarily share their resources, we propose to design protocols that operate according to pre-determined social norms. To optimize their long-term performance when playing such a game, peers can learn to play the best response by solving individual stochastic control problems. We first show that when a peer learns in an environment in which its opponents play a fixed strategy, learning will provide an advantage for this peer (i.e. it will lead to an increased utility for the learning peer). If all the peers in the network learn, we prove that learning remains beneficial for the peers. Moreover, we prove that the network will converge to the "fully-cooperative state" (where a socially optimal outcome is attained) if the update error γ of the peers\´ reputations is sufficiently small and the benefit of participating in the stage game is sufficiently larger than the incurred cost.
Keywords :
learning (artificial intelligence); peer-to-peer computing; protocols; stochastic games; P2P network; incentive; peer to peer network; protocol; resource sharing; social norm; stochastic control problem; Games; Markov processes; Peer to peer computing; Protocols; Servers; Transient analysis; Writing; Markov Decision Process; Peer-to-Peer Networks; Social Norm; Stochastic Control;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on
Conference_Location :
Prague
Print_ISBN :
978-1-4577-0538-0
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2011.5947675