• DocumentCode
    51095
  • Title

    Similarity Assessment Model for Chinese Sign Language Videos

  • Author

    Li-Chun Wang ; Ru Wang ; De-Hui Kong ; Bao-Cai Yin

  • Author_Institution
    Beijing Key Lab. of Multimedia & Intell. Software Technol., Beijing Univ. of Technol., Beijing, China
  • Volume
    16
  • Issue
    3
  • fYear
    2014
  • fDate
    Apr-14
  • Firstpage
    751
  • Lastpage
    761
  • Abstract
    This paper proposes a model for measuring similarity between videos which content is Chinese Sign Language (CSL), vision and sign language semantic are considered for the model. Vision component of the model is distance based on Volume Local Binary Patterns (VLBP), which is robust for motion and illumination. Semantic component of the model computes semantic distance based on definition of sign language semantic, which is defined as hand shape, location, orientation and movements. While quantizing the sign language semantic, contour is used to measure shape and orientation; trajectory is used for measuring location and movement. Experiment results show that proposed assessment model is effective and assessing result given by the model is close to subjective scoring.
  • Keywords
    image matching; image motion analysis; shape recognition; sign language recognition; video signal processing; CSL; Chinese sign language videos; VLBP; hand location; hand movements; hand orientation; hand shape; model semantic component; model vision component; semantic distance; sign language semantic; similarity assessment model; volume local binary patterns; Assistive technology; Gesture recognition; Semantics; Shape; Trajectory; Videos; Visualization; Chinese sign language video; human visual system (HVS); sign language semantic; video similarity assessment;
  • fLanguage
    English
  • Journal_Title
    Multimedia, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1520-9210
  • Type

    jour

  • DOI
    10.1109/TMM.2014.2298382
  • Filename
    6704715