Context-aware codebook learning for mobile landmark recognition

This paper presents a codebook learning based mobile landmark recognition technique based on context information that is acquired from mobile devices. Previous codebook learning methods are mainly developed on nonmobile platforms such as desktop PC, hence underutilize context features such as location and direction information as provided by the mobile devices. The proposed technique employs both the direction and location information to learn the codebook for mobile landmark recognition. A set of direction-aware leaf codewords are first generated by using direction data to decompose the leaf nodes of the original SVT. A visual word significance learning algorithm is then developed by considering location information to generate a compact codebook for image encoding. Experiments on the NTU50Landmark database show that the proposed method can achieve good recognition performance in mobile landmark recognition.