Title :
Dynamic partition and replication algorithm for storage capacity limited distributed social network
Author :
Pin Lv ; Qianni Deng
Author_Institution :
Dept. of Comput. Sci. & Eng., Shanghai Jiao Tong Univ., Shanghai, China
Abstract :
Large scale online social networks (OSN) are usually based on distributed storage systems. The data of users are distributed on multiple storage and computing nodes to provide concurrency and redundancy. How to store and access user data efficiently in OSN system with limited storage has practical significance. This paper proposes a dynamic partitioning and replication algorithm, which partitions and replicates user data periodically in line with the frequency of user interaction, in order to improve local access ratio and reduce system communication load. Through experiment on a real-world dataset, this paper testifies that compared with random partitioning and replication, the proposed algorithm could improve local access ratio greatly, and finally reduce access latency.
Keywords :
concurrency control; information retrieval; social networking (online); OSN system; computing nodes; concurrency; distributed storage systems; dynamic partitioning; large scale online social networks; multiple storage; random partitioning; random replication; real-world dataset; replication algorithm; storage capacity limited distributed social network; system communication load reduction; user data access; user data replication; user data storage; user interaction; Clustering algorithms; Heuristic algorithms; History; Partitioning algorithms; Redundancy; Social network services; Time factors; distributed storage system; dynamic partition and replication; online social network; storage capacity limited;
Conference_Titel :
Progress in Informatics and Computing (PIC), 2014 International Conference on
Conference_Location :
Shanghai
Print_ISBN :
978-1-4799-2033-4
DOI :
10.1109/PIC.2014.6972365