Parameterization for fading compensation

Patent metadata

Field	Value
Publication number	US-9363536-B2
Application number	US-201213584671-A
Country	US
Kind code	B2
Filing date	Aug 13, 2012
Priority date	May 3, 2002
Publication date	Jun 7, 2016
Grant date	Jun 7, 2016

Abstract

Techniques and tools for performing fading compensation in video processing applications are described. For example, during encoding, a video encoder performs fading compensation using fading parameters comprising a scaling parameter and a shifting parameter on one or more reference images. During decoding, a video decoder performs corresponding fading compensation on the one or more reference images.

First claim

We claim:

1. A computing device that implements a video encoder, the computing device comprising:
one or more processors;
memory;
at least one input device, output device, or communication connection; and
one or more storage media storing instructions for causing the computing device to perform a method of encoding video information comprising:
for a current video frame having plural reference video frames, signaling a fading compensation flag at a first syntax level in a video bitstream; and
when the fading compensation flag at the first syntax level indicates fading compensation is activated for the current video frame having plural reference video frames, signaling plural fading parameters at a second syntax level lower than the first syntax level in the video bitstream, wherein the plural fading parameters are for fading compensation for at least part of the current video frame having plural reference video frames, and wherein the fading compensation comprises adjusting plural pixel values in the plural reference video frames based at least in part on the plural fading parameters.

2. The computing device of claim 1 wherein the plural pixel values in the plural reference video frames comprise luminance values and chrominance values.

3. The computing device of claim 1 wherein the plural pixel values include all pixel values in the plural reference video frames.

4. The computing device of claim 1 wherein the first syntax level is frame level and wherein the second syntax level is a portion of a frame.

5. The computing device of claim 1 wherein the plural fading parameters comprise at least one weighting parameter and at least one offset parameter.

6. The computing device of claim 1 wherein the plural fading parameters include one or more fading parameters for adjusting luminance values and one or more different fading parameters for adjusting chrominance values.

7. The computing device of claim 1 further comprising:
detecting whether fading occurs in the current video frame relative to one or more of the plural reference video frames.

8. The computing device of claim 7 , wherein the detecting comprises:
computing an error measure for the current video frame relative to one or more of the plural reference video frames; and
comparing the error measure with a fading detection threshold.

9. The computing device of claim 8 further comprising:
before the computing the error measure, downsampling the current video frame and one or more of the plural reference video frames.

10. The computing device of claim 8 wherein the error measure is absolute error sum.

11. A computing device that implements a video decoder, the computing device comprising:
one or more processors;
memory;
at least one input device, output device, or communication connection; and
one or more storage media storing instructions for causing the computing device to perform a method of decoding video information comprising:
for a current video frame having plural reference video frames:
receiving and processing a fading compensation flag at a first syntax level in a video bitstream; and
when the fading compensation flag at the first syntax level indicates fading compensation is activated for the current video frame having plural reference video frames, receiving and processing plural fading parameters at a second syntax level lower than the first syntax level in the video bitstream, wherein the plural fading parameters are for fading compensation for at least part of the current video frame, and wherein the fading compensation comprises adjusting plural pixel values in the plural reference video frames based at least in part on the plural fading parameters.

12. The computing device of claim 11 wherein the plural pixel values in the plural reference video frames comprise luminance values and chrominance values.

13. The computing device of claim 11 wherein the plural pixel values include all pixel values in the plural reference video frames.

14. The computing device of claim 11 wherein the first syntax level is frame level and wherein the second syntax level is a portion of a frame.

15. The computing device of claim 11 wherein the plural fading parameters comprise at least one weighting parameter and at least one offset parameter.

16. The computing device of claim 11 wherein the plural fading parameters include one or more fading parameters for adjusting luminance values and one or more different fading parameters for adjusting chrominance values.

17. A computing device that implements a video decoder, the computing device comprising:
one or more processors;
memory;
at least one input device, output device, or communication connection; and
one or more storage media storing instructions for causing the computing device to perform a method of decoding video information comprising:
for a current video frame having plural reference video frames:
receiving and processing a fading compensation flag at a level of the current video frame in a video bitstream; and
when the fading compensation flag at the level of the current video frame indicates fading compensation is activated for the current video frame having plural reference video frames, receiving and processing plural fading parameters at a level of an individual block, macroblock or group of macroblocks of the current video frame in the video bitstream, wherein the plural fading parameters are for fading compensation for at least part of the current video frame, and wherein the fading compensation comprises adjusting plural pixel values in the plural reference video frames based at least in part on the plural fading parameters.

18. The computing device of claim 17 wherein the plural pixel values in the plural reference video frames comprise luminance values and chrominance values.

19. The computing device of claim 17 wherein the plural pixel values include all pixel values in the plural reference video frames.

20. The computing device of claim 17 further comprising a display and a wireless communication connection.

Assignees

• Srinivasan Sridhar
• Regunathan Shankar
• Microsoft Technology Licensing Llc

Inventors

• Srinivasan Sridhar
• Regunathan Shankar

Classifications

• H04N19/186

  the unit being a colour or a chrominance component · CPC title

• H04N19/85 Primary

  using pre-processing or post-processing specially adapted for video compression · CPC title

• H04N19/91

  Entropy coding, e.g. variable length coding [VLC] or arithmetic coding · CPC title

• H04N19/17

  the unit being an image region, e.g. an object · CPC title

• H04N19/53

  Multi-resolution motion estimation; Hierarchical motion estimation · CPC title