• DocumentCode
    840575
  • Title

    Random Sampling for Continuous Streams with Arbitrary Updates

  • Author

    Tao, Yufei ; Lian, Xiang ; Papadias, Dimitris ; Hadjieleftheriou, Marios

  • Author_Institution
    Dept. of Comput. Sci. & Eng., Chinese Univ. of Hong Kong
  • Volume
    19
  • Issue
    1
  • fYear
    2007
  • Firstpage
    96
  • Lastpage
    110
  • Abstract
    The existing random sampling methods have at least one of the following disadvantages: they 1) are applicable only to certain update patterns, 2) entail large space overhead, or 3) incur prohibitive maintenance cost. These drawbacks prevent their effective application in stream environments (where a relation is updated by a large volume of insertions and deletions that may arrive in any order), despite the considerable success of random sampling in conventional databases. Motivated by this, we develop several fully dynamic algorithms for obtaining random samples from individual relations, and from the join result of two tables. Our solutions can handle any update pattern with small space and computational overhead. We also present an in-depth analysis that provides valuable insight into the characteristics of alternative sampling strategies and leads to precision guarantees. Extensive experiments validate our theoretical findings and demonstrate the efficiency of our techniques in practice
  • Keywords
    database management systems; estimation theory; sampling methods; continuous stream; conventional database; in-depth analysis; random sampling method; Costs; Databases; Heuristic algorithms; Histograms; History; Intrusion detection; Sampling methods; Sampling; selectivity estimation.;
  • fLanguage
    English
  • Journal_Title
    Knowledge and Data Engineering, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1041-4347
  • Type

    jour

  • DOI
    10.1109/TKDE.2007.250588
  • Filename
    4016518