Activity-based synthesized frame generation in 3DTI video

Author

Chen, S. ; Nahrstedt, Klara

Author_Institution

Dept. of Comput. Sci., Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA

fYear

2013

fDate

15-19 July 2013

Firstpage

1

Lastpage

6

Abstract

In view of the high resource demand of 3D Tele-immersion (3DTI), we propose a user activity-based resource adaptation scheme that adjusts the compression ratio of 3DTI videos according to the user activity. The compression technique we designed is based on the frame synthesis via feature-based morphing. This technique is customized for 3DTI video due to the special properties of its scenes and the depth information provided by the system. Via a machine learning approach, our system can classify the user´s current activity and choose the most suitable priority among temporal resolution, spatial resolution, and resource consumption in the adaptation. Our results show that the resource saving can reach up to 25% without perceptible degradation of the 3DTI videos.

Keywords

feature extraction; image classification; image morphing; image resolution; learning (artificial intelligence); natural scenes; resource allocation; video coding; 3D teleimmersion resource demand; 3DTI video compression ratio; depth information; feature-based morphing; frame synthesis; machine learning approach; resource consumption; resource saving; spatial resolution; temporal resolution; user activity-based resource adaptation scheme; user activity-based synthesized frame generation; user current activity classification; Degradation; Feature extraction; Measurement; Quality of service; Spatial resolution; Speech; Three-dimensional displays; 3D tele-immersion; QoE; SVM; morphing; resource adaptation;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo (ICME), 2013 IEEE International Conference on

Conference_Location

San Jose, CA

ISSN

1945-7871

Type

conf

DOI

10.1109/ICME.2013.6607586

Filename

6607586