• DocumentCode
    519362
  • Title

    Compressed StreamCube: Implementation of Compressed Data Cube in DSMS

  • Author

    Liang, Gan ; Runheng, Li ; Yan, Jia ; Xin, Jin

  • Author_Institution
    Sch. of Comput., Nat. Univ. of Defense Technol., Changsha, China
  • Volume
    1
  • fYear
    2010
  • fDate
    5-6 June 2010
  • Firstpage
    345
  • Lastpage
    349
  • Abstract
    Using data cube to analysis historical fact data online more faster than Ad-Hoc queries, but it need very large external storage. In DSMS (Data Stream Management System), due to capacity of memory is much smaller than disk, we meet even more problem in analyzing stream data by in-memory StreamCube. So, we compress StreamCube to gain more information about stream data in certain storage. We implement two compressed structures of StreamCube, StreamDwarf and StreamQCTree, base on state-of-the-art compressed data cube, Dwarf and QCtree. For example, we make a query cost model of StreamQCTree, and get that if we choose the proper cells to materialized, queries using a partial materialized cube costs a little more than the case of a fully materialized cube, the query response time is still kept close to StreamQCTree. Experiments show that compressed StreamCube performs well in tradeoff between storage space and queries response time.
  • Keywords
    data analysis; data compression; data mining; data warehouses; query processing; DSMS; OLAP; StreamDwarf; StreamQCTree; ad-hoc queries; compressed StreamCube; compressed data cube; data stream management system; data warehouse; historical fact data online; on-line analytical processing; Costs; Data analysis; Data mining; Data warehouses; Delay; Educational institutions; Gallium nitride; Industrial engineering; Memory management; Space technology; Compressed StreamCube; Data Stream; OLAP; StreamCube; StreamDwarf; StreamQCTree;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Computing, Control and Industrial Engineering (CCIE), 2010 International Conference on
  • Conference_Location
    Wuhan
  • Print_ISBN
    978-0-7695-4026-9
  • Type

    conf

  • DOI
    10.1109/CCIE.2010.94
  • Filename
    5492096