Research of Distributed Data Store Based on HDFS

This paper analyzes the advantages and disadvantages of the traditional HDFS cluster architecture. An application framework designed for the small and medium-sized HDFS clusters is proposed in this paper to make up for incomplete HDFS application architecture, difficulties on deploying, inefficiency on I/O processing of small files. In addition, a caching mechanism is added to optimize the operation system on processing small files. Experiments show that this plan is feasible and the increased disk cache can significantly improve the efficiency of processing small files and optimize the system.