Title :
Elicit spoken-style data from social media through a style classifier
Author :
Ananlada Chotimongkol;Vataya Chunwijitra;Sumonmas Thatphithakkul;Nattapong Kurpukdee;Chai Wutiwiwatchai
Author_Institution :
NECTEC, National Science and Technology Development Agency (NSTDA), 112 Pahonyothin Road, Pathumthani, 12120, Thailand
Abstract :
We explore the use of social media data to reduce the effort in developing a conversational speech corpus. The LOTUS-SOC corpus is created by recording Twitter messages through a mobile application. In the first phase, which took around one month, 172 hours of speech from 208 speakers were recorded and ready for use without the need for speech segmentation and transcription. In terms of language similarity to spoken language, the perplexity of LOTUS-SOC with respect to known spoken utterances is lower than that of the broadcast news corpus and almost as low as the telephone conversation corpus. We also applied a style classifier trained from words and parts-of-speech using two machine learning approaches, SVM and CRF, to identify spoken-style utterances in LOTUS-SOC. By training a language model from only the utterances classified as “spoken”, the perplexity of LOTUS-SOC was further reduced as evaluated by three different sets of spoken utterances.
Keywords :
"Speech","Vocabulary","Twitter","Media","Training","Data collection","Speech processing"
Conference_Titel :
Oriental COCOSDA held jointly with 2015 Conference on Asian Spoken Language Research and Evaluation (O-COCOSDA/CASLRE), 2015 International Conference
DOI :
10.1109/ICSDA.2015.7357856