• DocumentCode
    3731306
  • Title

    Buffering strategies in HDFS environment with STORM framework

  • Author

    Istv?n Finta;L?r?nt Farkas;S?ndor Sz?n?si;Szabolcs Sergy?n

  • Author_Institution
    Research, Nokia Networks, K?ztelek utca 6, Budapest, Hungary
  • fYear
    2015
  • Firstpage
    297
  • Lastpage
    302
  • Abstract
    Hadoop Distributed File System (HDFS) is the de facto file system in vanilla Hadoop and most of open source Hadoop distributions. However HDFS suffers from the so called Small File Problem. Storm is a parallelized stream processing framework. In this paper we evaluate buffering strategies to mitigate the small file problem. In our evaluations Storm will be the small file source.
  • Keywords
    "Storms","Synchronization","Buffer storage","Topology","Informatics","Radiation detectors","XML"
  • Publisher
    ieee
  • Conference_Titel
    Computational Intelligence and Informatics (CINTI), 2015 16th IEEE International Symposium on
  • Type

    conf

  • DOI
    10.1109/CINTI.2015.7382939
  • Filename
    7382939
    • Link To Document
    https://search.isc.ac/dl/search/defaultta.aspx?DTC=49&DC=3731306