An Adaptive Nonlocal Regularized Shadow Removal Method for Aerial Remote Sensing Images

Shadows are evident in most aerial images with high resolutions, particularly in urban scenes, and their existence obstructs the image interpretation and the following application, such as classification and target detection. Most current shadow removal methods were proposed for natural images, whereas shadows in remote sensing images show distinct characteristics. We have therefore analyzed the characteristics of shadows in aerial images, and in this paper, we propose a new shadow removal method for aerial images, using nonlocal (NL) operators. In the proposed method, the soft shadow is introduced to replace the traditional binary hard shadow. NL operators are used to regularize the shadow scale and the updated shadow-free image. Furthermore, a spatially adaptive NL regularization is introduced to handle compound shadows. The combination of the soft shadow and NL operators yields satisfying shadow-free results, preserving textures and holding regular color. Different types of shadowed aerial images are employed to verify the proposed method, and the results are compared with two other methods. The experimental results confirm the validity of the proposed method and the advantage of the soft-shadow approach.