Title :
A dynamic method for metadata partitioning based on intensive access of spatial data
Author :
Lin Yanping ; Li Rui ; Xu zhengquan ; Guo Rui
Author_Institution :
State Key Lab. for Inf. Eng. in Surveying, Mapping & Remote Sensing, Wuhan Univ., Wuhan, China
Abstract :
In the object-based storage architecture of spatial data, accesses to metadata are 50% to 80% of the total data accesses, so metadata management and partitioning are very important. However, many typical and traditional methods for metadata partitioning, such as directory subtree partitioning, hashing partitioning, etc., should face the issues of hotspot and load balancing. In this paper, we analyzed the accesses to spatial data that follows Zipf-like distribution and has locality of reference, and proposed a dynamic method for metadata partitioning based on intensive access pattern of spatial data. This method considered the temporal locality and spatial locality of accesses to tile, put forward tile access rank algorithm based on the sum of access times per interval time, and got tile access probability by Zipf-like´s law for dynamic hashing partitioning of metadata. The experiment results presented the improving of efficiency in tile access rank, and showed that the method for metadata partitioning is an effective solution for hotspot and load balancing issues.
Keywords :
meta data; resource allocation; storage management; visual databases; Zipf-like distribution; Zipf-like law; directory subtree partitioning; dynamic hashing partitioning; dynamic method; load balancing; metadata management; metadata partitioning; object-based storage architecture; spatial data intensive access; spatial locality; temporal locality; tile access rank algorithm; Algorithm design and analysis; File systems; Heuristic algorithms; Partitioning algorithms; Servers; Spatial databases; Tiles; Zipf-like distribution; access pattern; load balancing; metadata partitioning;
Conference_Titel :
Information Technology and Artificial Intelligence Conference (ITAIC), 2011 6th IEEE Joint International
Conference_Location :
Chongqing
Print_ISBN :
978-1-4244-8622-9
DOI :
10.1109/ITAIC.2011.6030304