DocumentCode
519362
Title
Compressed StreamCube: Implementation of Compressed Data Cube in DSMS
Author
Liang, Gan ; Runheng, Li ; Yan, Jia ; Xin, Jin
Author_Institution
Sch. of Comput., Nat. Univ. of Defense Technol., Changsha, China
Volume
1
fYear
2010
fDate
5-6 June 2010
Firstpage
345
Lastpage
349
Abstract
Using data cube to analysis historical fact data online more faster than Ad-Hoc queries, but it need very large external storage. In DSMS (Data Stream Management System), due to capacity of memory is much smaller than disk, we meet even more problem in analyzing stream data by in-memory StreamCube. So, we compress StreamCube to gain more information about stream data in certain storage. We implement two compressed structures of StreamCube, StreamDwarf and StreamQCTree, base on state-of-the-art compressed data cube, Dwarf and QCtree. For example, we make a query cost model of StreamQCTree, and get that if we choose the proper cells to materialized, queries using a partial materialized cube costs a little more than the case of a fully materialized cube, the query response time is still kept close to StreamQCTree. Experiments show that compressed StreamCube performs well in tradeoff between storage space and queries response time.
Keywords
data analysis; data compression; data mining; data warehouses; query processing; DSMS; OLAP; StreamDwarf; StreamQCTree; ad-hoc queries; compressed StreamCube; compressed data cube; data stream management system; data warehouse; historical fact data online; on-line analytical processing; Costs; Data analysis; Data mining; Data warehouses; Delay; Educational institutions; Gallium nitride; Industrial engineering; Memory management; Space technology; Compressed StreamCube; Data Stream; OLAP; StreamCube; StreamDwarf; StreamQCTree;
fLanguage
English
Publisher
ieee
Conference_Titel
Computing, Control and Industrial Engineering (CCIE), 2010 International Conference on
Conference_Location
Wuhan
Print_ISBN
978-0-7695-4026-9
Type
conf
DOI
10.1109/CCIE.2010.94
Filename
5492096
Link To Document