Creating 3DCG Objects like Toy Blocks from a Picture on a Sketchbook

In this research we improved "Amazing Sketchbook" to create 3DCG objects like toy blocks and interact with them. "Amazing Sketchbook" is an interactive media tool. This tool monitors a physical sketchbook with a camera and analyzes a picture an the sketchbook, and a user can create 3DCG objects interactively by drawing a picture with physical color pens on the sketchbook. It is also possible to interact with the created 3DCG objects by touching the picture on the sketchbook or shaking the sketchbook. Our tool does not require drafts to color in, and a user can draw arbitrary pictures on a physical sketchbook. Interaction with 3DCG objects through a sketchbook is also originality of our tool. We improved our tool to realize more various shapes creation and interaction. We developed new methods to create 3DCG objects like toy blocks from a picture on a sketchbook. Our tool decides the way of piling up toy blocks automatically according to the shapes and colors of drawn objects on the sketchbook, and creates 3D objects made by virtual toy blocks interactively. It is also possible to interact with the 3D objects made by virtual blocks. When the user shakes the sketchbook, our tool would detect the movement of the 3D objects from a video sequence of the camera, and 3D objects made by virtual toy blocks would move and break into pieces. Our tool could use for entertainment, education, digital signage, and so on.