User interaction in mixed reality interactive storytelling

Author

Cavazza, Marc ; Martin, Olivier ; Charles, Fred ; Marichal, Xavier ; Mead, Steven J.

Author_Institution

Sch. of Comput. & Math., Teesside Univ., Middlesbrough, UK

fYear

2003

fDate

7-10 Oct. 2003

Firstpage

304

Lastpage

305

Abstract

In this paper, we describe a mixed reality system based on a "magic mirror" model, in which the user\´s image is captured in real time by a video camera, extracted from his/her background and mixed with a 3D graphic model of a virtual image including the synthetic characters taking part in the story. The resulting image is projected on a large screen facing the user, who sees his/her own image embedded in the virtual stage with the synthetic actors. The graphic component of the mixed reality world is based on a game engine, Unreal Tournament 2003. This engine not only performs graphic rendering and character animation but incorporates a new version of our previously described storytelling engine. A single 2D camera facing the user analyses the image in real-time by segmenting the user\´s contours.

Keywords

augmented reality; cameras; computer animation; edge detection; entertainment; rendering (computer graphics); user interfaces; 3D graphic model; Unreal Tournament 2003; character animation; game engine; graphic component; graphic rendering; interactive storytelling; magic mirror model; mixed reality; real time; storytelling engine; synthetic actors; synthetic characters; user contour; user image; user interaction; video camera; virtual image; virtual stage; Animation; Cameras; Engines; Graphics; Image analysis; Image segmentation; Mirrors; Real time systems; Rendering (computer graphics); Virtual reality;

fLanguage

English

Publisher

ieee

Conference_Titel

Mixed and Augmented Reality, 2003. Proceedings. The Second IEEE and ACM International Symposium on

Print_ISBN

0-7695-2006-5

Type

conf

DOI

10.1109/ISMAR.2003.1240732

Filename

1240732