Mining High-Level Features from Video Using Associations and Correlations

Association rule mining (ARM) has been studied in the areas of content-based multimedia retrieval and semantic concept detection due to its high efficiency and accuracy. Two important processes in mining the association rules for classification are rule generation and rule selection. In this paper, a novel high-level feature detection framework using the ARM technique together with the correlations among the feature-value pairs is proposed. A new association rule mining (ARM) algorithm has been developed, where the N-feature-value pairs are generated using a combined measure based on (1) the existence of the (N-1)-feature-value pairs (where N is larger than 1), (2) the correlation between different N-feature-value pairs and the concept classes through multiple correspondence analysis (MCA), and (3) the similarity representing the harmonic mean of the inter-similarity and intra-similarity. The final association classification rules are selected by using the calculated harmonic mean of the similarity values. The proposed framework enables the automatic discovery and generation of the N-feature-value pair association rules from the N-feature-value pairs for classification. Experimenting with 15 high-level features (concepts) and benchmark data sets from TRECVID, our proposed framework achieves promising performance and outperforms three other well-known classifiers (decision trees, support vector machine, and neural networks) which are commonly used for performance comparison in the TRECVID community.