DocumentCode :
3009516
Title :
Parallelization of FM-Index
Author :
Zhang, Di ; Zhang, Yunquan ; Liu, Shengfei ; Huang, Xiaodi
Author_Institution :
Inst. of Software, Chinese Acad. of Sci., Beijing
fYear :
2008
fDate :
25-27 Sept. 2008
Firstpage :
169
Lastpage :
173
Abstract :
A parallel design and implementation of FM-index is presented in this paper. In applications, the performance of the FM-index is crucial, which is a self-contained, highly compressed indexing algorithm. With the popularity of multi-core processors, parallel computing allows the FM-index to run faster by performing multiple computations simultaneously when possible. Our approach works by splitting input data into overlapping blocks with equal size, and running them through the FM-index algorithm simultaneously on multiple processors. After analyzing and refactoring the sequential version, we organize the data flows of all operations according to a unified parallel framework. The experimental results show that, in general our approach has achieved a significant and sub-linear speedup on widespread symmetrical multi-processing architectures. This will greatly reduce the running time of executing operations on large data sets.
Keywords :
data structures; indexing; parallel processing; FM-Index; indexing algorithm; multicore processors; parallel computing; parallel design; parallel implementation; Application software; Computer architecture; Concurrent computing; Contracts; High performance computing; Indexing; Information technology; Multicore processing; Parallel processing; Software performance; Block processing; FM-index; Multi-core; Parallel computing; Self-index;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
High Performance Computing and Communications, 2008. HPCC '08. 10th IEEE International Conference on
Conference_Location :
Dalian
Print_ISBN :
978-0-7695-3352-0
Type :
conf
DOI :
10.1109/HPCC.2008.165
Filename :
4637694
Link To Document :
بازگشت