Title :
Transfer of Supervision for Improved Address Standardization
Author :
Kothari, G. ; Faruquie, Tanveer A. ; Subramaniam, L. Venkata ; Prasad, K. Hima ; Mohania, Mukesh K.
Author_Institution :
IBM Res. India, New Delhi, India
Abstract :
Address Cleansing is very challenging, particularly for geographies with variability in writing addresses. Supervised learners can be easily trained for different data sources. However, training requires labeling large corpora for each data source which is time consuming and labor intensive to create. We propose a method to automatically transfer supervision from a given labeled source to a target unlabeled source using a hierarchical dirichlet process. Each dirichlet process models data from one source. The shared component distribution across these dirichlet processes captures the semantic relation between data sources. A feature projection on the component distributions from multiple sources is used to transfer supervision.
Keywords :
data handling; geographic information systems; learning (artificial intelligence); statistical distributions; stochastic processes; address cleansing; address standardization; hierarchical Dirichlet process; shared component distribution; supervised learner; Adaptation model; Buildings; Clustering algorithms; Data models; Roads; Semantics; Training; HDP; address cleansing; address standardization; transfer learning;
Conference_Titel :
Pattern Recognition (ICPR), 2010 20th International Conference on
Conference_Location :
Istanbul
Print_ISBN :
978-1-4244-7542-1
DOI :
10.1109/ICPR.2010.533