Title :
Compressed StreamCube: Implementation of Compressed Data Cube in DSMS
Author :
Liang, Gan ; Runheng, Li ; Yan, Jia ; Xin, Jin
Author_Institution :
Sch. of Comput., Nat. Univ. of Defense Technol., Changsha, China
Abstract :
Using data cube to analysis historical fact data online more faster than Ad-Hoc queries, but it need very large external storage. In DSMS (Data Stream Management System), due to capacity of memory is much smaller than disk, we meet even more problem in analyzing stream data by in-memory StreamCube. So, we compress StreamCube to gain more information about stream data in certain storage. We implement two compressed structures of StreamCube, StreamDwarf and StreamQCTree, base on state-of-the-art compressed data cube, Dwarf and QCtree. For example, we make a query cost model of StreamQCTree, and get that if we choose the proper cells to materialized, queries using a partial materialized cube costs a little more than the case of a fully materialized cube, the query response time is still kept close to StreamQCTree. Experiments show that compressed StreamCube performs well in tradeoff between storage space and queries response time.
Keywords :
data analysis; data compression; data mining; data warehouses; query processing; DSMS; OLAP; StreamDwarf; StreamQCTree; ad-hoc queries; compressed StreamCube; compressed data cube; data stream management system; data warehouse; historical fact data online; on-line analytical processing; Costs; Data analysis; Data mining; Data warehouses; Delay; Educational institutions; Gallium nitride; Industrial engineering; Memory management; Space technology; Compressed StreamCube; Data Stream; OLAP; StreamCube; StreamDwarf; StreamQCTree;
Conference_Titel :
Computing, Control and Industrial Engineering (CCIE), 2010 International Conference on
Conference_Location :
Wuhan
Print_ISBN :
978-0-7695-4026-9
DOI :
10.1109/CCIE.2010.94