Lips-Control Assistive Communication System for The Serious Disabled

We realized a set of assistive system based on lips images recognition for communication of the disabled. This system is composed with the software system mainly and the hardware system auxiliary. In this system, the software system can be divided into two major parts. The first part is to develop a recognition algorithm for the opened/closed status of lips images, including the face detection, the face tracking, the lips pattern recognition, the lips locations and extraction, the lips images processing etc. The second part is to develop a fuzzy algorithm for recognizing long tone/silence or short tone/silence of Morse codes. After the fuzzy recognition, the open/close statuses of lips images can be transferred to Morse codes to input the characters, achieving the functions of word processing. Regarding to the hardware of the assistive system, we have primarily realized the remote control system for electrical home appliances. Once it obtains information of open/close statuses of lips images after the software recognition, then the original parallel port interface of general computer and RF module can be used to carry out further remote control function of home appliances. In conclusion, we have completed the assistive communication system for the disabled with no need of any type of appurtenance. We improve some defects of traditional auxiliary system. It will be unnecessary to wear any type of appurtenance. We believe that the assistive system will be more helpful for the serious disabled especially with vertebra damaged. We hope our study can improve the communication abilities of the disabled and make some contributions to society.