DocumentCode :
2139358
Title :
The algorithm of the join data stream with diskresident relation
Author :
Wei Du ; Xianxia Zou
Author_Institution :
Dept. of Comput. Sci., GongDong Police Coll., Guangzhou, China
fYear :
2013
fDate :
23-25 July 2013
Firstpage :
1188
Lastpage :
1193
Abstract :
Current data integration approaches are moving towards real-time updates. One important element in real-time data integration is the join of a continuous incoming data stream with a disk-resident relation. Because data stream is infinite, it is impossible to adopt blocking join algorithms such as sort-merge and hash join. The novel algorithm MESHJOIN has been proposed for joining a continuous stream with a disk-resident relation. The crux of MESHJOIN algorithm is that the whole memory block of disk-based relation is replaced at each iteration. We propose that the memory block is divided into a number of logical partitions, and then only one logical partition of memory block is replaced at each iteration. The experimental results show that the service rate of the join is increased because I/O cost for one loop iteration is decreased.
Keywords :
data integration; MESHJOIN algorithm; blocking join algorithms; continuous incoming data stream; data integration approach; disk-based relation; disk-resident relation; hash join algorithm; join data stream algorithm; join service rate; logical partition; loop iteration; realtime data integration; sort-merge algorithm; Algorithm design and analysis; Data warehouses; Indexes; Memory management; Partitioning algorithms; Real-time systems; Semantics; disk-resident relation; join; logical partition; relational data stream;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Natural Computation (ICNC), 2013 Ninth International Conference on
Conference_Location :
Shenyang
Type :
conf
DOI :
10.1109/ICNC.2013.6818158
Filename :
6818158
Link To Document :
بازگشت