Lyric-based automatic music image generator for music browser using scene knowledge

This paper presents a proposal of a music image generator for users to grasp music easily and instantaneously on consumer electronics devices such as music players and smartphones. It provides users faster and more efficient music browsing functionality using a technique that automatically generates a music image that matches lyric contents. More specifically, a scene theme such as an event or place is extracted from lyrics using text mining techniques. A suitable music image is then created dynamically to match this extracted scene theme. This image generation is achieved by synthesizing multiple image materials to express the extracted scene theme flexibly. For choosing image materials, scene knowledge that has representative scene object compositions is proposed. Using this knowledge, the image synthesizer can select appropriate materials. Finally, the performance of the proposed automatic knowledge creation method is evaluated by comparison with manually created knowledge. Based on optimal parameters calculated in the evaluation, some examples of music images for well-known music lyrics are presented. In addition, the implemented system applying the proposed generator onto a server-side and a consumer-side consumer electronics device is also described.