Title :
Parallel module network learning on distributed memory multiprocessors
Author :
Liu, Long ; Hu, Wei ; Lai, Chunrong ; Jiang, Hong-Shan ; Chen, Wenguang ; Zheng, Weimin ; Zhang, Yimin
Author_Institution :
Dept. Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
Abstract :
As an extension of the Bayesian network, the module network is used in situations where there are many variables but only a small set of data available. However, using this network is still time-consuming. In this paper, the authors proposed a parallel implementation of the module network, a less time-consuming, learning algorithm based on the message-passing model. In order to solve the load-imbalance problem introduced by either result caching or intrinsic computation, a grouping strategy was proposed, which groups computations by modules and then distributes them cyclically. The algorithm was tested on eight 4-way Intel Xeon multiprocessors. Speedups of 29.26 on 32 processors have been observed. The result shows that our algorithm is effective.
Keywords :
belief networks; distributed memory systems; message passing; multiprocessor interconnection networks; parallel algorithms; resource allocation; Bayesian network; caching; distributed memory multiprocessors; intrinsic computation; learning algorithm; load balancing; message passing; parallel module network learning; Algorithm design and analysis; Bayesian methods; Bioinformatics; Cells (biology); Computer science; Distributed computing; Parallel processing; Parallel programming; Speech processing; Testing; MPI; Module Network; cache; load balance; parallelization;
Conference_Titel :
Parallel Processing, 2005. ICPP 2005 Workshops. International Conference Workshops on
Print_ISBN :
0-7695-2381-1
DOI :
10.1109/ICPPW.2005.66