Clothing segmentation and recoloring using background subtraction and back projection method

This paper proposes a new method to automatically segment and re-color the clothing in an image sequence. Background and foreground are separated using background subtraction method with a Gaussian mixture model built for the static scene. Skin and face areas are detected and removed on the segmented foreground. A 2D histogram is constructed using the remaining pixels to model the probability distribution of the clothing chromaticity, which is then applied to each frame to find accurate clothing area using back projection method. The segmented clothing area is re-colored by mapping the hue value to a new one in the HSV color space to maintain the contrast of the clothing. Experiments on the real video captured with a monocular webcam are shown to demonstrate the effectiveness of the proposed algorithm for clothing segmentation and re-coloring.