Title :
ConnectBoard: A remote collaboration system that supports gaze-aware interaction and sharing
Author :
Tan, Kar-Han ; Robinson, Ian ; Samadani, Ramin ; Lee, Bowon ; Gelb, Dan ; Vorbau, Alex ; Culbertson, Bruce ; Apostolopoulos, John
Author_Institution :
Multimedia Commun. & Networking Lab., Hewlett-Packard Labs., Palo Alto, CA, USA
Abstract :
We present ConnectBoard, a new system for remote collaboration where users experience natural interaction with one another, seemingly separated only by a vertical, transparent sheet of glass. It overcomes two key shortcomings of conventional video communication systems: the inability to seamlessly capture natural user interactions, like using hands to point and gesture at parts of shared documents, and the inability of users to look into the camera lens without taking their eyes off the display. We solve these problems by placing the camera behind the screen, where the remote user is virtually located. The camera sees through the display to capture images of the user. As a result, our setup captures natural, frontal views of users as they point and gesture at shared media displayed on the screen between them. Users also never have to take their eyes off their screens to look into the camera lens. Our novel optical solution based on wavelength multiplexing can be easily built with off-the-shelf components and does not require custom electronics for projector-camera synchronization.
Keywords :
gesture recognition; human computer interaction; image sensors; telecontrol; video signal processing; ConnectBoard; camera lens; gaze-aware interaction; gaze-aware sharing; projector-camera synchronization; remote collaboration system; video communication systems; wavelength multiplexing; Cameras; Collaboration; Contacts; Displays; Eyes; Lenses; Mirrors; Multimedia communication; Multimedia systems; Switches;
Conference_Titel :
Multimedia Signal Processing, 2009. MMSP '09. IEEE International Workshop on
Conference_Location :
Rio De Janeiro
Print_ISBN :
978-1-4244-4463-2
Electronic_ISBN :
978-1-4244-4464-9
DOI :
10.1109/MMSP.2009.5293268