DocumentCode :
1324177
Title :
An object-based system for stereoscopic viewpoint synthesis
Author :
Ohm, Jens-Rainer ; Izquierdo, M. Ebroul
Author_Institution :
Dept. of Image Processing, Dusseldorf Univ., Germany
Volume :
7
Issue :
5
fYear :
1997
fDate :
10/1/1997 12:00:00 AM
Firstpage :
801
Lastpage :
811
Abstract :
This paper describes algorithms that were developed for a real-time stereoscopic videoconferencing systems with viewpoint adaptation. The goal is a real telepresence illusion, which is achieved by synthesis of intermediate views from a stereoscopic camera shot with a rather large baseline. The actual viewpoint will be adapted according to the head position of the viewer, such that the impression of motion parallax is produced. The object-based system first identifies foreground and background regions and applies disparity estimation to the foreground object. A hierarchical block matching algorithm is employed for this purpose which takes into account the position of high-activity feature points and the object/background border positions. Using the disparity estimator´s output, it is possible to generate arbitrary intermediate views by projections from the left- and right-view images. For this purpose, we have also developed an object-based interpolation algorithm, taking into account a very simple convex-surface model of a person´s face and body. Though the algorithms had to be held rather simple under the constraint of hardware feasibility, we obtain a good quality of the intermediate-view images. Finally, we describe the hardware concept for the disparity estimator, which is the most complicated part of the algorithm
Keywords :
image matching; image segmentation; interpolation; motion estimation; real-time systems; stereo image processing; teleconferencing; virtual reality; background region identification; convex surface model; disparity estimation; foreground region identification; head position; hierarchical block matching algorithm; intermediate views synthesis; motion parallax; object based interpolation algorithm; object based system; object/background border positions; real-time stereoscopic videoconferencing; stereoscopic camera; stereoscopic viewpoint synthesis; telepresence illusion; Cameras; Displays; Educational technology; Glass; Hardware; Head; Interpolation; Layout; Teleconferencing; Videoconference;
fLanguage :
English
Journal_Title :
Circuits and Systems for Video Technology, IEEE Transactions on
Publisher :
ieee
ISSN :
1051-8215
Type :
jour
DOI :
10.1109/76.633502
Filename :
633502
Link To Document :
بازگشت