• DocumentCode
    1796494
  • Title

    Scalable bootstrap clustering for massive data

  • Author

    Haocheng Wang ; Fuzhen Zhuang ; Xiang Ao ; Qing He ; Zhongzhi Shi

  • Author_Institution
    Key Lab. of Intell. Inf. Process., Inst. of Comput. Technol., Beijing, China
  • fYear
    2014
  • fDate
    June 30 2014-July 2 2014
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    The bootstrap provides a simple and powerful means of improving the accuracy of clustering. However, for today´s increasingly large datasets, the computation of bootstrap-based quantities can be prohibitively demanding. In this paper we introduce the Bag of Little Bootstraps Clustering (BLBC), a new procedure which utilizes the Bag of Little Bootstraps technique to obtain a robust, computationally efficient means of clustering for massive data. Moreover, BLBC is suited to implementation on modern parallel and distributed computing architectures which are often used to process large datasets. We investigate empirically the performance characteristics of BLBC and compare to the performances of existing methods via experiments on simulated data and real data. The results show that BLBC has a significantly more favorable computational profile than the bootstrap based clustering while maintaining good statistical correctness.
  • Keywords
    parallel processing; pattern clustering; BLBC; bag of little bootstraps clustering technique; distributed computing architectures; massive data; parallel computing architectures; scalable bootstrap clustering; Accuracy; Clustering algorithms; Computer architecture; Distributed computing; Partitioning algorithms; Program processors; Vectors; bag of little boot-straps; clustering; data mining; machine learning; parallel and distributed computing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), 2014 15th IEEE/ACIS International Conference on
  • Conference_Location
    Las Vegas, NV
  • Type

    conf

  • DOI
    10.1109/SNPD.2014.6888693
  • Filename
    6888693