Title :
A Knowledge Resources Based Neural Network for Learning Word and Relation Representations
Author :
Shuhan Yuan;Yang Xiang;Maozhen Li
Author_Institution :
Sch. of Electron. &
Abstract :
Using neural networks to train high quality distributed representations of words and multi-relational data has attracted a great attention in recent years. Mapping the words and their relations to low-dimensional continues vector spaces has proved to be useful in natural language processing and information extraction tasks. In this paper, we present a neural network based model that can train word embeddings and relation embeddings taking into account unlabeled text data and knowledge resources jointly. In particular, we use both contexts and definitions of words as neural network inputs to train word embeddings. Based on the word embeddings, we train relation embeddings by defining a proper projecting operation between words. Experiments on various tasks like word similarity and link prediction show that the proposed method can achieve high quality on word and relation representations.
Keywords :
"Semantics","Context","Neural networks","Knowledge based systems","Training","Context modeling","Knowledge engineering"
Conference_Titel :
High Performance Computing and Communications (HPCC), 2015 IEEE 7th International Symposium on Cyberspace Safety and Security (CSS), 2015 IEEE 12th International Conferen on Embedded Software and Systems (ICESS), 2015 IEEE 17th International Conference on
DOI :
10.1109/HPCC-CSS-ICESS.2015.107