Multilingual speech to speech MT based chat system

This paper presents a chat application that make use of speech as interaction mode between users in their mother tongue. This system is based on Machine Translation (MT) which automatically translates a sentence from one language to other. Now-a-days, Chat has become increasingly important as an effective means to communicate in social networks. But in existing personal chat systems, chat services are text-based only. To circumvent this issue, innovative, practical XMPP-based chat system architecture is proposed in this paper that creates a Speech based chat services by integrating state-of-the-art technologies like Automatic Speech Recognition (ASR), Text to Speech (TTS) and Machine Translation (MT). The proposed system eliminates the need to have a common language for chat communication. In this chat system the user speak in their own language after selecting the language of their comfort. The audio will be recognized in real time. The text is translated to the language opted by end user and the system synthesizes it. Here, we discuss an interface prototype that can overcome the language barrier to some extent.