• DocumentCode
    2139358
  • Title

    The algorithm of the join data stream with diskresident relation

  • Author

    Wei Du ; Xianxia Zou

  • Author_Institution
    Dept. of Comput. Sci., GongDong Police Coll., Guangzhou, China
  • fYear
    2013
  • fDate
    23-25 July 2013
  • Firstpage
    1188
  • Lastpage
    1193
  • Abstract
    Current data integration approaches are moving towards real-time updates. One important element in real-time data integration is the join of a continuous incoming data stream with a disk-resident relation. Because data stream is infinite, it is impossible to adopt blocking join algorithms such as sort-merge and hash join. The novel algorithm MESHJOIN has been proposed for joining a continuous stream with a disk-resident relation. The crux of MESHJOIN algorithm is that the whole memory block of disk-based relation is replaced at each iteration. We propose that the memory block is divided into a number of logical partitions, and then only one logical partition of memory block is replaced at each iteration. The experimental results show that the service rate of the join is increased because I/O cost for one loop iteration is decreased.
  • Keywords
    data integration; MESHJOIN algorithm; blocking join algorithms; continuous incoming data stream; data integration approach; disk-based relation; disk-resident relation; hash join algorithm; join data stream algorithm; join service rate; logical partition; loop iteration; realtime data integration; sort-merge algorithm; Algorithm design and analysis; Data warehouses; Indexes; Memory management; Partitioning algorithms; Real-time systems; Semantics; disk-resident relation; join; logical partition; relational data stream;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Natural Computation (ICNC), 2013 Ninth International Conference on
  • Conference_Location
    Shenyang
  • Type

    conf

  • DOI
    10.1109/ICNC.2013.6818158
  • Filename
    6818158