Optimization algorithm of massive data query based on JOIN

Author

Zheng Jiajia ; Sun Jiasong

Author_Institution

Dept. of Electron. Eng., Tsinghua Univ., Beijing, China

fYear

2014

fDate

27-29 June 2014

Firstpage

933

Lastpage

936

Abstract

The paper uses parallel computation of grid and data grid as theoretical basis. The isomerism of each node and difference of communication rate under grid environment, and massive data query makes query operations of database difficult. For the new structural characteristic, the paper proposes a parallel JOIN algorithm based on massive data, it fully uses parallelism and reduces transmission volume to shorten response time. The paper includes implementation and optimization of JOIN algorithm, fault-tolerant mechanism, RDMM, partition and transmission of massive data.

Keywords

fault tolerant computing; grid computing; optimisation; parallel algorithms; query processing; RDMM; data grid; database; fault-tolerant mechanism; massive data query; optimization algorithm; parallel JOIN algorithm; parallel computation; Algorithm design and analysis; Clustering algorithms; Indexes; Joints; Parallel processing; Time factors; grid computation; massive data; optimization algorithm; parallel computing;

fLanguage

English

Publisher

ieee

Conference_Titel

Software Engineering and Service Science (ICSESS), 2014 5th IEEE International Conference on

Conference_Location

Beijing

ISSN

2327-0586

Print_ISBN

978-1-4799-3278-8

Type

conf

DOI

10.1109/ICSESS.2014.6933718

Filename

6933718