Vision-Based Projection-Handwriting Integration in Classroom

A projector based presentation and a whiteboard handwriting capture system, when monitored by a camera, could provide a better means to present a lecture in a classroom and later to deliver more effective e-lectures for off-campus students. When the PowerPoint© (PPT) slides are projected on the whiteboard where the instructor annotates, modifies, or expands the PPT presentation, geometrically registering high-resolution images from the two sources yields high quality digital presentations. Since the two sources do not share the same materials, one with printing notes and the other with handwriting notes, a digital camera is used as a bridge to align the two sources, as well as to record the whole lecture. We present a hybrid registration approach to align the PPT and handwriting images and then propose a coarse-to-fine content matching method to register handwriting contents captured by the video camera and the whiteboard capture system. We also show an integrated user-customized presentation system to provide students better lecturing context. Experimental results are presented to validate our approach, and future research directions are also discussed.