Title :
Optimize Multidimensional Arrays Queries with Heterogeneous Replica Method
Author :
Meiqi Zhu ; Xiaomeng Huang ; Songbin Liu ; Haohuan Fu ; Qiming Fang ; Guangwen Yang
Author_Institution :
Minist. of Educ. Key Lab. for Earth Syst. Modeling, Tsinghua Univ., Beijing, China
Abstract :
Multidimensional arrays are commonly used in scientific and engineering applications. The disk layout for the multidimensional arrays will obviously affect the performance of data querying. Homogeneous Replica method are widely used to maintain the data reliability in most of the distributed storage systems and used to improve the data locality in some parallel processing systems. In this paper, we propose a novel method, that is heterogeneous replicas, to makes better use of the replica method to optimize the performance of multidimensional arrays querying. The experimental results shows that heterogeneous replicas method can significantly reduce the overhead of disk I/O for most of the queries. With three heterogeneous replicas, the performance of random generated range queries for multidimensional datasets can be improved for 30% on the average.
Keywords :
data integrity; parallel processing; query processing; replicated databases; data querying; data reliability; disk I/O overhead reduction; disk layout; heterogeneous replica method; multidimensional arrays queries; multidimensional datasets; random generated range queries; Arrays; Benchmark testing; Distributed databases; Layout; Meteorology; Shape; Tiles; Distributed Storage; Heterogeneous Replication; Multidimensional array; Query Optimization;
Conference_Titel :
Networking, Architecture and Storage (NAS), 2013 IEEE Eighth International Conference on
Conference_Location :
Xi´an
DOI :
10.1109/NAS.2013.43