DocumentCode :
3464832
Title :
Using vision based tracking to support real-time graphical instruction for students who have visual impairments
Author :
Fang, Bing ; Oliveira, Francisco ; Quek, Francis
Author_Institution :
Virginia Polytech. Inst. & State Univ., Blacksburg, VA, USA
fYear :
2010
fDate :
13-18 June 2010
Firstpage :
9
Lastpage :
14
Abstract :
In this paper, we describe a real-time vision-based tracking system to help students who are blind or visually impaired (SBVI) to follow instructional discourse that employs graphical illustrations. The vision system employs a color model based tracking for both the instructor´s pointing behavior and the SBVI´s reading behavior, and maps the pointing positions into the same coordinates. Our Haptic Deictic System - HDS system also employs a haptic glove to provide SBVI access to the situated pointing behavior of instructor that is performed in conjunction with speech, and provides the instructor real-time visual feedback on the SBVI´s reading actions. Thus, our system supports two-way situated multimodal communication. In this paper, we first introduce our system, and then we discuss studies that show the efficacy of our approach.
Keywords :
cameras; computer aided instruction; computer graphics; data gloves; handicapped aids; color model based tracking; haptic deictic system; haptic glove; real time graphical instruction; real time visual feedback; vision based tracking; visual impairments; Cameras; Drives; Feedback; Fingers; Graphics; Haptic interfaces; Machine vision; Real time systems; Speech; Target tracking;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on
Conference_Location :
San Francisco, CA
ISSN :
2160-7508
Print_ISBN :
978-1-4244-7029-7
Type :
conf
DOI :
10.1109/CVPRW.2010.5543588
Filename :
5543588
Link To Document :
بازگشت