• DocumentCode
    69572
  • Title

    Rate-Distortion Model Based Bit Allocation for 3-D Facial Compression Using Geometry Video

  • Author

    Junhui Hou ; Lap-Pui Chau ; Ying He ; Minqi Zhang ; Magnenat-Thalmann, Nadia

  • Author_Institution
    Nanyang Technol. Univ., Singapore, Singapore
  • Volume
    23
  • Issue
    9
  • fYear
    2013
  • fDate
    Sept. 2013
  • Firstpage
    1537
  • Lastpage
    1541
  • Abstract
    With the extensive applications of 3-D multimedia technology, 3-D content compression has been an important issue, which ensures its smooth transmission on the network with constrained bandwidth. In this letter, we propose a new compression framework for dynamic 3-D facial expressions. Taking advantage of the near-isometric property of human facial expressions, we parameterize the dynamic 3-D faces into an expression-invariant canonical domain, which naturally generates 2-D geometry videos and allows us to apply the well-studied video compression techniques. Due to the difference from natural videos, each dimension (i.e., X, Y and Z, respectively) of the geometry video is regarded as a video sequence and encoded separately. Meanwhile, a model-based joint bit allocation scheme is designed to allocate reasonable bitrate to each dimension by detailed analysis of rate-distortion model for geometry videos, to obtain optimal results under given target bitrate. Experimental results show that up to 25% improvement in terms of bitrate reduction can be achieved, compared to existing algorithms.
  • Keywords
    data compression; face recognition; geometry; image sequences; rate distortion theory; video coding; 2D geometry video; 3D content compression; 3D facial compression; 3D multimedia technology; constrained bandwidth; dynamic 3D human facial expression; expression-invariant canonical domain; geometry video compression technique; model-based joint bit allocation scheme; near-isometric property; rate-distortion model; video encoding; video sequence; Bit rate; Complexity theory; Encoding; Geometry; Mathematical model; Rate-distortion; Video coding; Dynamic 3-D facial expressions; H.264/AVC; geometry video; joint bit allocation; mesh compression; rate distortion model;
  • fLanguage
    English
  • Journal_Title
    Circuits and Systems for Video Technology, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1051-8215
  • Type

    jour

  • DOI
    10.1109/TCSVT.2013.2248971
  • Filename
    6470663