A wireless network based multi-modal information perception framework and its application

After analyzing the developing of the healthcare and rehabilitation service robot technology, this paper puts forward a multi-modal information perception system based on modular and open design idea. First, a general structure of this framework and its working process are elaborated. Then, an instance is built according to the proposed framework, and in this instance, multi-modality information perception and feedback to the human-robot interaction are realized. At last, experiments are taken on this instance and the results show that the proposed framework and design ideas are feasible.