Title :
A unified approach to restoration, deinterlacing and resolution enhancement in decoding MPEG-2 video
Author :
Martins, Bo ; Forchhammer, Søren
Author_Institution :
Dept. of Telecommun., Tech. Univ. Denmark, Lyngby, Denmark
fDate :
9/1/2002 12:00:00 AM
Abstract :
The quality and spatial resolution of video can be improved by combining multiple pictures to form a single superresolution picture. We address the special problems associated with pictures of variable but somehow parameterized quality such as MPEG-decoded video. Our algorithm provides a unified approach to restoration, chrominance upsampling, deinterlacing, and resolution enhancement. A decoded MPEG-2 sequence for interlaced standard definition television (SDTV) in 4:2:0 is converted to: (1) improved quality interlaced SDTV in 4:2:0; (2) interlaced SDTV in 4:4:4; (3) progressive SDTV in 4:4:4; (4) interlaced high-definition TV (HDTV) in 4:2:0; (5) progressive HDTV in 4:2:0. These conversions also provide features such as freeze frame and zoom. The algorithm is mainly targeted at bit rates of 4-8 Mb/s. The algorithm is based on motion-compensated spatial upsampling from multiple images and decimation to the desired format. The processing involves an estimated quality of individual pixels based on MPEG image type and local quantization value. The mean-squared error (MSE) is reduced, compared to the directly decoded sequence, and annoying ringing artifacts, including mosquito noise, are effectively suppressed. The superresolution pictures obtained by the algorithm are of much higher visual quality and have lower MSE than superresolution pictures obtained by simple spatial interpolation.
Keywords :
decoding; high definition television; image enhancement; image resolution; image restoration; image sequences; interference suppression; mean square error methods; motion compensation; quantisation (signal); video coding; 4 to 8 Mbit/s; HDTV; MPEG-2 video decoding; MSE; chrominance upsampling; deinterlacing; freeze frame; high-definition TV; interlaced standard definition television; mean square error; motion compensation; resolution enhancement; restoration; superresolution picture; zoom; Bit rate; Decoding; HDTV; Image converters; Image restoration; Noise reduction; Pixel; Quantization; Spatial resolution; TV;
Journal_Title :
Circuits and Systems for Video Technology, IEEE Transactions on
DOI :
10.1109/TCSVT.2002.803227