DocumentCode :
840575
Title :
Random Sampling for Continuous Streams with Arbitrary Updates
Author :
Tao, Yufei ; Lian, Xiang ; Papadias, Dimitris ; Hadjieleftheriou, Marios
Author_Institution :
Dept. of Comput. Sci. & Eng., Chinese Univ. of Hong Kong
Volume :
19
Issue :
1
fYear :
2007
Firstpage :
96
Lastpage :
110
Abstract :
The existing random sampling methods have at least one of the following disadvantages: they 1) are applicable only to certain update patterns, 2) entail large space overhead, or 3) incur prohibitive maintenance cost. These drawbacks prevent their effective application in stream environments (where a relation is updated by a large volume of insertions and deletions that may arrive in any order), despite the considerable success of random sampling in conventional databases. Motivated by this, we develop several fully dynamic algorithms for obtaining random samples from individual relations, and from the join result of two tables. Our solutions can handle any update pattern with small space and computational overhead. We also present an in-depth analysis that provides valuable insight into the characteristics of alternative sampling strategies and leads to precision guarantees. Extensive experiments validate our theoretical findings and demonstrate the efficiency of our techniques in practice
Keywords :
database management systems; estimation theory; sampling methods; continuous stream; conventional database; in-depth analysis; random sampling method; Costs; Databases; Heuristic algorithms; Histograms; History; Intrusion detection; Sampling methods; Sampling; selectivity estimation.;
fLanguage :
English
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
Publisher :
ieee
ISSN :
1041-4347
Type :
jour
DOI :
10.1109/TKDE.2007.250588
Filename :
4016518
Link To Document :
بازگشت