Evaluating Gesture Recognition by Multiple-Sensor-Containing Mobile Devices

Mobile phones or video game controllers using gesture recognition technologies enable easy and intuitive operations. However, usually only one of each type of sensor is installed in each device, and the effect of multiple sensors on recognition accuracy has not been investigated. Moreover, the effect of the differences in the motion of a gesture has not been examined. We captured data for 27 kinds of gestures by using a mobile device with 9 accelerometers and 9 gyroscopes, we then experimentally investigated the effects on recognition accuracy of changing the number and positions of sensors, and the number and kinds of gestures. The results showed that the use of multiple sensors and of sensors positioned at specific positions affects accuracy. It was also shown that gestures are interdependent and selecting specific gestures improves recognition accuracy.