Title :
Parallel information retrieval on a distributed memory multiprocessor system
Author :
Chung, Sang-Hwa ; Oh, Soo-Cheol ; Ryu, Kwang Ryel ; Park, Soo-hee
Author_Institution :
Dept. of Comput. Eng., Pusan Nat. Univ., South Korea
Abstract :
This paper presents a parallel information retrieval (IR) system which provides information for users with precision and speed. For precision, the IR system adopts a full-text search method. To supply a fast information service, parallel processing techniques are used, so multiple queries are processed concurrently and each of these queries is also handled in parallel using multiple processors. For the efficient utilization of multiple processors, we developed a processor allocation method which dynamically assigns various-size processor clusters for incoming queries based on the current workload of the system. The parallel IR model is implemented on a multi-transputer system composed of 16 processors. According to the experiments, a linear speed-up of up to 11.3-fold is obtained, and network and hard disk overheads are negligible in comparison with the response time
Keywords :
distributed databases; distributed memory systems; full-text databases; information retrieval; information services; parallel processing; query processing; resource allocation; transputer systems; Internet; distributed memory multiprocessor system; full-text search method; hard disk overhead; information service; multiple queries; multitransputer system; network overhead; parallel information retrieval system; processor allocation method; processor clusters; response time; system workload; Concurrent computing; Delay; Hard disks; IP networks; Information retrieval; Internet; Multiprocessing systems; Pattern matching; Search engines; Search methods;
Conference_Titel :
Algorithms and Architectures for Parallel Processing, 1997. ICAPP 97., 1997 3rd International Conference on
Conference_Location :
Melbourne, Vic.
Print_ISBN :
0-7803-4229-1
DOI :
10.1109/ICAPP.1997.651488
