• DocumentCode
    1791553
  • Title

    Incremental window aggregates over array database

  • Author

    Li Jiang ; Kawashima, Hitoshi ; Tatebe, Osamu

  • Author_Institution
    Grad. Sch. of Syst. & Inf. Eng., Univ. of Tsukuba, Tsukuba, Japan
  • fYear
    2014
  • fDate
    27-30 Oct. 2014
  • Firstpage
    183
  • Lastpage
    188
  • Abstract
    We propose an efficient window aggregation method over multi-dimensional array data based on incremental computation. We improve several aggregations with different data structures exploited to achieve efficient computation: list for sum and avg, heap for max and min, and balanced binary search tree for percentile. We present time complexity analysis for the methods, and then evaluate performance with experiments in SciDB array database system with both synthetic and JRA55 meteorological dataset. Our analysis shows that performance improvement is proportional to the window size in the last dimension in theory, and the result of experiment is consistent with the analysis. In certain cases, it shows an acceleration factor more than 13 by the proposed method with percentile, while a factor over 28 with maximum.
  • Keywords
    computational complexity; database management systems; parallel processing; tree data structures; JRA55 meteorological dataset; SciDB array database system; acceleration factor; balanced binary search tree; data structures; heap; incremental computation; incremental window aggregates; list; multidimensional array data; time complexity analysis; window aggregation method; Aggregates; Arrays; Binary search trees; Computational efficiency; Sorting; Time complexity; Array Database; Incremental Computation; Multi-Dimensional Array; Window Aggregates;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Big Data (Big Data), 2014 IEEE International Conference on
  • Conference_Location
    Washington, DC
  • Type

    conf

  • DOI
    10.1109/BigData.2014.7004230
  • Filename
    7004230