Title :
Parallel Data Cube Construction Based on an Extendible Multidimensional Array
Author :
Jin, Dong ; Tsuji, Tatsuo
Author_Institution :
Coll. of Inf. Eng., Qingdao Univ., Qingdao, China
Abstract :
The pre-computation of data cubes is critical for improving the response time of OLAP(On-Line Analytical Processing) systems. In order to meet the need for improved performance created by growing data sizes, parallel solutions for data cube construction are becoming increasingly important. This paper presents two parallel methods for data cube construction based on an extendible multidimensional array, which is dynamically extendible along any dimension without relocating any existing data. We have implemented and evaluated our core-based parallel data cube construction methods on shared-memory multiprocessors. Given the performance limit, the methods achieve close to linear speedup with load balance. Our experiments also indicate that our parallel methods can be more scalable on higher dimensional data cube construction.
Keywords :
data mining; parallel databases; resource allocation; shared memory systems; OLAP; extendible multidimensional array; load balance; on-line analytical processing system; parallel data cube construction; parallel database; shared-memory multiprocessors; Algorithms; Arrays; Finite impulse response filter; History; Parallel processing; Radiation detectors; Scalability; MOLAP; data cube; extendible array; multi-core; parallel database; shared-memory multiprocessors;
Conference_Titel :
Trust, Security and Privacy in Computing and Communications (TrustCom), 2011 IEEE 10th International Conference on
Conference_Location :
Changsha
Print_ISBN :
978-1-4577-2135-9
DOI :
10.1109/TrustCom.2011.155