• DocumentCode
    2169756
  • Title

    Tight lower bounds for the distinct elements problem

  • Author

    Indyk, Piotr ; Woodruff, David

  • Author_Institution
    MIT, Cambridge, MA, USA
  • fYear
    2003
  • fDate
    11-14 Oct. 2003
  • Firstpage
    283
  • Lastpage
    288
  • Abstract
    We prove strong lower bounds for the space complexity of (ε, δ)-approximating the number of distinct elements F0 in a data stream. Let m be the size of the universe from which the stream elements are drawn. We show that any one-pass streaming algorithm for (ε, δ)-approximating F0 must use Ω(1/ε2) space when ε = Ω(m-1(9 + k)/), for any k > 0, improving upon the known lower bound of Ω(1/ε) for this range of ε. This lower bound is tight up to a factor of log log m for small ε and log 1/ε for large ε. Our lower bound is derived from a reduction from the one-way communication complexity of approximating a Boolean function in Euclidean space. The reduction makes use of a low-distortion embedding from an l2 to l1 norm.
  • Keywords
    Boolean functions; communication complexity; Boolean function; Euclidean space; data stream element; distinct element problem; one-pass streaming algorithm; one-way communication complexity; space complexity; tight lower bound; Algorithm design and analysis; Approximation algorithms; Boolean functions; Complexity theory; Computer crime; Databases; IP networks;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Foundations of Computer Science, 2003. Proceedings. 44th Annual IEEE Symposium on
  • ISSN
    0272-5428
  • Print_ISBN
    0-7695-2040-5
  • Type

    conf

  • DOI
    10.1109/SFCS.2003.1238202
  • Filename
    1238202