• DocumentCode
    3459605
  • Title

    A novel approach to American Sign Language (ASL) phrase verification using reversed signing

  • Author

    Zafrulla, Zahoor ; Brashear, Helene ; Hamilton, Harley ; Starner, Thad

  • Author_Institution
    Sch. of Interactive Comput., Georgia Inst. of Technol., Atlanta, GA, USA
  • fYear
    2010
  • fDate
    13-18 June 2010
  • Firstpage
    48
  • Lastpage
    55
  • Abstract
    We propose a novel approach for American Sign Langauge (ASL) phrase verification that combines confidence measures (CM) obtained from aligning forward sign models (the conventional approach) to the input data with the CM´s obtained from aligning reversed sign models to the same input. To demonstrate our approach we have used two CM´s, the Normalized likelihood score and the Log-Likelihood Ratio (LLR).We perform leave-one-signer-out cross validation on a dataset of 420 ASL phrases obtained from five deaf children playing an educational game called CopyCat. The results show that for the new method the alignment selected for signs in a test phrase has a significantly better match to the ground truth when compared to the traditional approach. Additionally, when a low false reject rate is desired the new technique can provide a better verification accuracy as compared to the conventional approach.
  • Keywords
    computer games; gesture recognition; handicapped aids; maximum likelihood estimation; ASL phrase verification; American sign language; CopyCat game; confidence measurement; forward sign models; leave-one-signer-out cross validation; log-likelihood ratio; normalized likelihood score; reversed sign models; reversed signing; Accelerometers; Cameras; Deafness; Educational institutions; Handicapped aids; Lattices; Layout; Production; Testing; Vocabulary;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on
  • Conference_Location
    San Francisco, CA
  • ISSN
    2160-7508
  • Print_ISBN
    978-1-4244-7029-7
  • Type

    conf

  • DOI
    10.1109/CVPRW.2010.5543268
  • Filename
    5543268