A supporting system of chorus singing for visually impaired persons using depth image sensor

This paper provides a study on a supporting system of chorus singing for visually impaired persons. This system is composed of an electric music baton with an acceleration sensor, a radio module, haptic interface devices with vibration motors, depth image sensor and a PC. An electric music baton transmits a signal of a conductor´s motion to visually impaired players based on an acceleration of the sensor. Since a conductor has to give individual instruction to a target player, we use a depth image sensor in order to recognize the pointing direction of a conductor´s music baton. The pointing direction of a conductor´s music baton is estimated based on the conductor´s posture. The effectiveness of our system is clarified by several experimental results.