Parallelisation of a statistics based dictionary generator

Author

Cai, Wentong ; Tan Chee Hiong ; Jyh, Paul Wu Hong

Author_Institution

Sch of Appl. Sci., Nanyang Technol. Univ., Singapore

fYear

1996

fDate

11-13 Jun 1996

Firstpage

209

Lastpage

216

Abstract

A statistics based dictionary generator was constructed based on a mathematical model proposed by the researchers from IBM T.J. Watson Research Centre. However, due to the large data site involved and the iterative nature of the algorithm, the execution of the generator is so time-consuming that its usefulness becomes a question. To improve the performance, parallelisation has been chosen as the avenue. In this paper, parallelisation of the generator will be described. The parallel algorithm will be analyzed. And the results of parallel execution time will also be discussed. In addition, some important conclusions will be drawn based on our experiments. The dictionary generator can be used in automatic machine translation. Thus, the benefit of the parallelisation can be considered, in general, in the context of natural language processing

Keywords

language translation; natural languages; parallel algorithms; automatic machine translation; dictionary generator; natural language processing; parallelisation; performance; Algorithm design and analysis; Computer aided instruction; Concurrent computing; Costs; Dictionaries; Iterative algorithms; Natural language processing; Natural languages; Parallel algorithms; Statistics;

fLanguage

English

Publisher

ieee

Conference_Titel

Algorithms & Architectures for Parallel Processing, 1996. ICAPP 96. 1996 IEEE Second International Conference on

Print_ISBN

0-7803-3529-5

Type

conf

DOI

10.1109/ICAPP.1996.562877

Filename

562877