Title :
A Distributed Graph Data Storage and Computing Framework
Author :
Wei Zhou;Yun Gao;Jizhong Han;Yinliang Yue;Zhiyong Xu
Author_Institution :
Inst. of Inf. Eng., Beijing, China
Abstract :
Graph has been widely adopted in Social Network Service (SNS) applications because it is very easy to represent user relationship information. In order to achieve high performance, prevalent algorithms tend to keep the graph data in memory to speed up the data access. However, failing to balance the costs of random access patterns and physical memory consumption hurts the effectiveness. In this paper, we propose a novel graph data processing framework to solve these issues. It develops a novel graph organization model to minimize the costs of graph data accesses and reduce the memory consumption. We compare our system with other graph processing systems on several widely used applications using large-scale real world SNS data, and results show that it outperforms the current mechanisms.
Keywords :
"Organizations","Memory management","Mathematical model","Throughput","Social network services","Data processing"
Conference_Titel :
High Performance Computing and Communications (HPCC), 2015 IEEE 7th International Symposium on Cyberspace Safety and Security (CSS), 2015 IEEE 12th International Conferen on Embedded Software and Systems (ICESS), 2015 IEEE 17th International Conference on
DOI :
10.1109/HPCC-CSS-ICESS.2015.308