Geometry-based ranking for mobile 3D visual search using hierarchically structured multi-view features

This paper proposes geometry-based ranking for mobile 3D visual search. It utilizes the underlying geometry of the 3D objects as well as the appearance to improve the ranking results. A double hierarchy has been embedded in the data structure, namely the hierarchically structured multi-view features for each object and a tree hierarchy from multi-view vocabulary trees. As the 3D geometry information is incorporated in the multi-view vocabulary tree, it allows us to evaluate the consistency of the 3D geometry at low computational complexity. Thus, a cost function is proposed for object ranking using geometric consistency. With that, we devise an iterative algorithm that accomplishes 3D geometry-based ranking. The experimental results show that our 3D geometry-based ranking improves the recall-datarate performance as well as the subjective ranking results for mobile 3D visual search.