Macroblock-level adaptive quantization in quality-aware video optimization

Patent metadata

Field	Value
Publication number	US-9621896-B2
Application number	US-201213492619-A
Country	US
Kind code	B2
Filing date	Jun 8, 2012
Priority date	Jun 10, 2011
Publication date	Apr 11, 2017
Grant date	Apr 11, 2017

Abstract

A method of optimizing an encoded video stream comprising one or more video frames, each video frame comprising a plurality of macroblocks, each macroblock comprising a plurality of pixels. The method includes receiving an encoded macroblock, decoding the encoded macroblock, and extracting a first quantization parameter. The first quantization parameter corresponds to quantization settings originally used for compressing the encoded macroblock. The method also includes computing a second quantization parameter based at least in part on the first quantization parameter, re-encoding the decoded macroblock based on the second quantization parameter, and providing the re-encoded macroblock.

First claim

What is claimed is:

1. A method of macroblock-level quality-aware video optimization of an encoded video stream comprising one or more video frames, each video frame comprising a plurality of macroblocks, each macroblock comprising a plurality of pixels, the method comprising:
receiving an encoded macroblock;
decoding the encoded macroblock;
extracting a first quantization parameter, wherein the first quantization parameter corresponds to quantization settings originally used for compressing the encoded macroblock;
determining first and second thresholds as a function of past input quantization parameters, wherein the past input quantization parameters correspond to quantization settings originally used for compressing a plurality of previously received encoded macroblocks;
computing a second quantization parameter based at least in part on the first quantization parameter, the first and second thresholds, and a number of bits occupied by the encoded macroblock;
re-encoding the decoded macroblock based on the second quantization parameter; and
providing the re-encoded macroblock.

2. The method of claim 1 , wherein computing the second quantization parameter comprises setting the second quantization parameter to be equal or lower than the first quantization parameter when the first quantization parameter is higher than the first threshold, and setting the second quantization parameter to be higher than the first quantization parameter when the first quantization parameter is lower than the second threshold.

3. The method of claim 1 , wherein computing the second quantization parameter is based in part on visual characteristics of the encoded macroblock or the decoded macroblock.

4. The method of claim 3 , wherein the visual characteristics of the encoded macroblock or the decoded macroblock include a variance of the plurality of pixels of either the encoded macroblock or the decoded macroblock.

5. The method of claim 3 , wherein the visual characteristics of the encoded macroblock or the decoded macroblock include an average brightness of the plurality of pixels of either the encoded macroblock or the decoded macroblock.

6. The method of claim 1 , wherein computing the second quantization parameter is based in part on output coding parameters received from an encoder.

7. The method of claim 6 , wherein the output coding parameters include one or more past output quantization parameters that correspond to quantization settings used for re-encoding previously received encoded macroblocks.

8. The method of claim 6 , wherein the output coding parameters include an output bitrate, wherein the output bitrate corresponds to an average number of bits occupied by a plurality of previously re-encoded macroblocks.

9. The method of claim 8 , wherein computing the second quantization parameter comprises increasing the second quantization parameter if the output bitrate is higher than a first predefined target bitrate, and decreasing the second quantization parameter if the output bitrate is lower than a second predefined target bitrate.

10. A non-transitory computer readable medium storing instructions that, when executed by a computer, cause the computer to perform a method of macroblock-level quality-aware video optimization of an encoded video stream comprising one or more video frames, each frame comprising a plurality of macroblocks, and each macroblock comprising a plurality of pixels, the method comprising:
receiving an encoded macroblock;
decoding the encoded macroblock;
extracting a first quantization parameter, wherein the first quantization parameter corresponds to quantization settings originally used for compressing the encoded macroblock;
determining first and second thresholds as a function of past input quantization parameters, wherein the past input quantization parameters correspond to quantization settings originally used for compressing a plurality of previously received encoded macroblocks;
computing a second quantization parameter based at least in part on the first quantization parameter, the first and second thresholds, and a number of bits occupied by the encoded macroblock;
re-encoding the decoded macroblock based on the second quantization parameter; and
providing the re-encoded macroblock.

11. The non-transitory computer readable medium of claim 10 , wherein computing the second quantization parameter comprises setting the second quantization parameter to be equal or lower than the first quantization parameter when the first quantization parameter is higher than the first threshold, and setting the second quantization parameter to be higher than the first quantization parameter when the first quantization parameter is lower than the second threshold.

12. The non-transitory computer readable medium of claim 10 , wherein computing the second quantization parameter is based in part on visual characteristics of the encoded macroblock or the decoded macroblock.

13. The non-transitory computer readable medium of claim 12 , wherein the visual characteristics of the encoded macroblock or the decoded macroblock include a variance of the plurality of pixels of either the encoded macroblock or the decoded macroblock.

14. The non-transitory computer readable medium of claim 12 , wherein the visual characteristics of the encoded macroblock or the decoded macroblock include an average brightness of the plurality of pixels of either the encoded macroblock or the decoded macroblock.

15. The non-transitory computer readable medium of claim 10 , wherein computing the second quantization parameter is based in part on output coding parameters received from an encoder.

16. The non-transitory computer readable medium of claim 15 , wherein the output coding parameters include one or more past output quantization parameters that correspond to quantization settings used for re-encoding previously received encoded macroblocks.

17. The non-transitory computer readable medium of claim 15 , wherein the output coding parameters include an output bitrate, wherein the output bitrate corresponds to an average number of bits occupied by a plurality of previously re-encoded macroblocks.

18. The non-transitory computer readable medium of claim 17 , wherein computing the second quantization parameter comprises increasing the second quantization parameter if the output bitrate is higher than a first predefined target bitrate, and decreasing the second quantization parameter if the output bitrate is lower than a second predefined target bitrate.

19. A video optimizer for macroblock-level quality-aware video optimization of an encoded video stream comprising one or more video frames, each frame comprising a plurality of macroblocks, and each macroblock comprising a plurality of pixels, the video optimizer comprising:
a decoder configured to receive an encoded macroblock, to decode the encoded macroblock, and to extract a first quantization parameter, wherein the first quantization parameter corresponds to quantization settings originally used for compressing the encoded macroblock;
a quantization parameter adjustment module configured to:
determine first and second thresholds as a function of past input quantization parameters, wherein the past input quantization parameters correspond to quantization settings originally used for compressing a plurality of previously received encoded macroblocks; and
compute a second quantization parameter based at least in part on the first quantization parameter and a number of bits occupied by the encoded macroblock; and

Assignees

• Tidemann Jeremy
• Penner Andrew
• Citrix Systems Inc

Inventors

• Tidemann Jeremy
• Penner Andrew

Classifications

• H04N19/146

  Data rate or code amount at the encoder output · CPC title

• H04N19/136

  Incoming video signal characteristics or properties · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• H04N19/40

  using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream · CPC title