DocumentCode :
3483339
Title :
Associative memory neural networks for information retrieval of text word pairs
Author :
Wang, P.F. ; Mosley, Coleman
Author_Institution :
Marine Environ. Quality Branch, SSC-SD, San Diego, CA, USA
Volume :
5
fYear :
2002
fDate :
18-22 Nov. 2002
Firstpage :
2200
Abstract :
Natural language information processing remains a challenge in linguistics. Existing methods for retrieval of text often use stemming to retain common roots and base recall on these root words. This requires the removal of stop words, e.g., numbers, symbols, high frequency bid low semantic weight words, thereby precluding phrases using these words. In addition stemming is a morphologic approach that cannot readily process homonyms, synonyms and certain inflectional and derived forms. Machine learning approaches assign words to categories, but application to a large corpus remains in debate. For this study, we describe the application of the Cortronic theory and methods developed by Robert Hecht-Nielsen (2002) to information retrieval of text word pairs. Hecht-Nielsen´s theories build on associative memory artificial neural networks (AMNNs) introduced by Steinbuch (1961) and extended by Willshaw et al. (1969) especially in regards sparseness. The AMNNs are used to process a large corpus without excluding stop words, and retain the joint probability of mutual occurrences that allows rapid retrieval of word pairs. This AMNN approach includes three key components: representation of arbitrary objects (words), learning and knowledge accumulation based on measurement of co-occurrence and use of all the learned knowledge to produce (predict) the missing word in a phrase.
Keywords :
content-addressable storage; information retrieval; linguistics; natural languages; neural nets; text analysis; AMNNs; Cortronic theory; arbitrary object representation; associative memory neural networks; information retrieval; knowledge accumulation; large corpus; linguistics; mutual occurrences; natural language information processing; rapid word pair retrieval; text word pairs; Artificial neural networks; Associative memory; Frequency; Information processing; Information retrieval; Machine learning; Natural languages; Neural networks; Neurons; Sparse matrices;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference on
Print_ISBN :
981-04-7524-1
Type :
conf
DOI :
10.1109/ICONIP.2002.1201883
Filename :
1201883
Link To Document :
بازگشت