Bag-of-Words and Object-Based Classification for Cloud Extraction From Satellite Imagery

Automatic cloud extraction from satellite imagery is an important task for many applications in remote sensing. Humans can easily identify various clouds from satellite images based on the visual features of cloud. In this study, a method of automatic cloud detection is proposed based on object classification of image features. An image is first segmented into superpixels so that the descriptor of each superpixel can be computed to form a feature vector for classification. The support vector machine algorithm is then applied to discriminate cloud and noncloud regions. Thereafter, the GrabCut algorithm is used to extract more accurate cloud regions. The key of the method is to deal with the highly varying patterns of clouds. The bag-of-words (BOW) model is used to construct the compact feature vectors from densely extracted local features, such as dense scale-invariant feature transform (SIFT). The algorithm is tested using 101 RapidEye and 86 Landsat images with many cloud patterns. These images achieve 89.2% of precision, 87.8% of recall for RapidEye, 85.8% of precision, and 83.9% of recall for Landsat. The experiments show that the method is insensitive to the number of codewords in the codebook construction of the BOW.