Development of an image processing based sheet music recognition system for iOS devices

Intelligent mobile devices with multiple sensors and technologies have been spread widely and gradually. This paper presents a sheet music recognition system that can automatically recognize and perform the musical score with a simulated piano on iOS devices. The overall music recognition system consists of three functional parts. The first part is designed to pre-process the input image of a musical score. The major task of the second part is to segment each individual object on the musical score followed by note and pitch recognition. Finally, the recognized notes are transformed to the MIDI forms and the musical score is performed by a simulated piano. The proposed system has been implemented as an App which can be run of iOS devices.