Shared-bed person segmentation based on motion estimation

Video-based sleep analysis is a topic with important applications, and shared-bed occurs frequently in the context of sleep. One difficulty for the shared-bed situation is to assign the movements to the correct person because they can occur in close proximity and even overlapping. To manage to achieve person segmentation in the shared-bed situation, in this paper we propose an approach to correctly segment the region of persons based on motion estimation. In our approach, considering the consistency of the motion vectors, specifically their length and angle, the adjacent blocks are clustered. The generated clusters are then assigned to a person according to temporal correlation. The occupied region of the person is updated each frame based on the assignment result of the clusters. The proposed approach tackles the segmentation issue when the two persons are close to each other or even overlap, and the accuracy of the segmentation is beyond 82% in the data set we acquired.