Automatic piano tutoring system using consumer-level depth camera

In this paper, we present an automatic piano tutoring system that uses a consumer-level depth camera to recognize keys that are touched by a performer in real-time. Accordingly, the system provides feedback to the performer as to whether the appropriate keys for playing a music score at the proper tempo are being touched. Our system can be installed on any piano system with a simple calibration process. As a result, any conventional acoustic piano can be converted into a piano tutor system with the addition of a low-cost depth camera.