• DocumentCode
    3761519
  • Title

    Memory-Based Data Storing Technologies on Hadoop Distribution File System

  • Author

    Aibo Song;Jinlin Tu;Jinghua Zhao;Xuejiao Qian

  • Author_Institution
    Sch. of Comput. Sci. &
  • fYear
    2015
  • Firstpage
    64
  • Lastpage
    68
  • Abstract
    A single storage medium of mass data storage lead to low throughput and long data access time delay. To solve these problems, Memory-based Data Storing Technologies on Hadoop Distribution File System is related. First, the calculation of memory available on each storage node, this part of the memory mapped to disk, and realize the HDFS to this part of the effective management of memory resources. And to establish a reasonable memory data exchange model, when the data is stored in the memory load growth to a certain extent, the memory file heat low displacement to disk, disk file in high heat move back into memory. Comparing with the HDFS based on disk storage, in this paper, the HDFS based on the memory data storage system can effectively shorten data access delay, improve the system of data throughput, with significant performance advantages.
  • Keywords
    "Heating","Memory management","Random access memory","Data processing","Distributed databases","File systems"
  • Publisher
    ieee
  • Conference_Titel
    Advanced Cloud and Big Data, 2015 Third International Conference on
  • Print_ISBN
    978-1-4673-8537-4
  • Type

    conf

  • DOI
    10.1109/CBD.2015.20
  • Filename
    7435454