Macroblock-level adaptive quantization in quality-aware video optimization

Patent metadata

Field	Value
Publication number	US-10123015-B2
Application number	US-201715482931-A
Country	US
Kind code	B2
Filing date	Apr 10, 2017
Priority date	Jun 10, 2011
Publication date	Nov 6, 2018
Grant date	Nov 6, 2018

Abstract

A method of optimizing an encoded video stream comprising one or more video frames, each video frame comprising a plurality of macroblocks, each macroblock comprising a plurality of pixels. The method includes receiving an encoded macroblock, decoding the encoded macroblock, and extracting a first quantization parameter. The first quantization parameter corresponds to quantization settings originally used for compressing the encoded macroblock. The method also includes computing a second quantization parameter based at least in part on the first quantization parameter, re-encoding the decoded macroblock based on the second quantization parameter, and providing the re-encoded macroblock.

First claim

What is claimed is:

1. A method for video optimization of an encoded video stream comprising one or more video frames, each video frame comprising a plurality of macroblocks, the method being performed by at least one processor, the method comprising:
receiving information for a macroblock of a video frame of the encoded video stream;
extracting a first quantization parameter corresponding to quantization settings originally used for compressing the macroblock;
determining, using the received information, motion vector information for at least one motion vector associated with the macroblock that indicates a location of at least one prediction block within the video frame or another video frame which was subtracted from the macroblock prior to encoding;
computing a second quantization parameter for re-encoding the macroblock, the second quantization parameter based at least in part on the first quantization parameter and the motion vector information;
re-encoding the macroblock based on the second quantization parameter; and
transmitting the re-encoded macroblock to a user device.

2. The method of claim 1 , wherein computing the second quantization parameter comprises setting the second quantization parameter to be equal or lower than the first quantization parameter when the first quantization parameter is higher than the first threshold, and setting the second quantization parameter to be higher than the first quantization parameter when the first quantization parameter is lower than the second threshold.

3. A method for video optimization of an encoded video stream comprising one or more video frames, each video frame comprising a plurality of macroblocks, the method being performed by at least one processor, the method comprising:
receiving information for a macroblock of a video frame of the encoded video stream;
extracting a first quantization parameter corresponding to quantization settings originally used for compressing the macroblock;
determining, using the received information, motion vector information for at least one motion vector associated with the macroblock;
computing a second quantization parameter for re-encoding the macroblock, the second quantization parameter based at least in part on the first quantization parameter and the motion vector information; and
re-encoding the macroblock based on the second quantization parameter; and
transmitting the re-encoded macroblock to a user device;
wherein the macroblock was encoded using inter-prediction, and the motion vector information is indicative of relative positions of one or more prediction blocks.

4. The method of claim 1 , further comprising:
performing a statistical analysis and obtain an average motion vector length, across macroblocks belonging to the video frame of the encoded video stream.

5. The method of claim 1 , further comprising
decreasing the second quantization parameter responsive to a determination that a length of the at least one motion vector is below a predetermined low threshold, and
increasing the second quantization parameter responsive to a determination that the length of the at least one motion vector is above a predetermined high threshold.

6. The method of claim 1 , wherein computing the second quantization parameter is based in part on visual characteristics extracted from the macroblock.

7. The method of claim 6 , wherein the visual characteristics of the encoded macroblock or the macroblock include a variance of a plurality of pixels of either the encoded macroblock or the macroblock.

8. The method of claim 6 , wherein the visual characteristics of the encoded macroblock or the macroblock include an average brightness of the plurality of pixels of either the encoded macroblock or the macroblock.

9. A non-transitory computer readable medium that stores a set of instructions that is executable by a at least one processor of a video optimization system to cause the video optimization system to perform a method for video optimization of an encoded video stream comprising one or more video frames, each frame comprising a plurality of macroblocks, the method comprising:
receiving information for a macroblock of a video frame of the encoded video stream;
extracting a first quantization parameter corresponding to quantization settings originally used for compressing the macroblock;
determining, using the received information, motion vector information for at least one motion vector associated with the macroblock that indicates a location of at least one prediction block within the video frame or another video frame which was subtracted from the macroblock prior to encoding;
computing a second quantization parameter for re-encoding the macroblock, the second quantization parameter based at least in part on the first quantization parameter and the motion vector information;
re-encoding the macroblock based on the second quantization parameter; and
transmitting the re-encoded macroblock to a user device.

10. The non-transitory computer readable medium of claim 9 , wherein computing the second quantization parameter comprises setting the second quantization parameter to be equal or lower than the first quantization parameter when the first quantization parameter is higher than the first threshold, and setting the second quantization parameter to be higher than the first quantization parameter when the first quantization parameter is lower than the second threshold.

11. A non-transitory computer readable medium that stores a set of instructions that is executable by a at least one processor of a video optimization system to cause the video optimization system to perform a method for video optimization of an encoded video stream comprising one or more video frames, each frame comprising a plurality of macroblocks, the method comprising:
receiving information for a macroblock of a video frame of the encoded video stream;

extracting a first quantization parameter corresponding to quantization settings originally used for compressing the macroblock;
determining, using the received information, motion vector information for at least one motion vector associated with the macroblock;
computing a second quantization parameter for re-encoding the macroblock, the second quantization parameter based at least in part on the first quantization parameter and the motion vector information;
re-encoding the macroblock based on the second quantization parameter; and
transmitting the re-encoded macroblock to a user device;
wherein the macroblock was encoded using inter-prediction, and the motion vector information is indicative of relative positions of one or more prediction blocks.

12. The non-transitory computer readable medium of claim 9 , wherein the at least one processor is configured to perform a statistical analysis and obtain an average motion vector length, across macroblocks belonging to the video frame of the encoded video stream.

13. The non-transitory computer readable medium of claim 9 , wherein the set of instructions that is executable by the at least one processor of the video optimization system cause the video optimization system to further perform:
decreasing the second quantization parameter responsive to a determination that a length of the at least one motion vector is below a predetermined low threshold, and
increasing the second quantization parameter responsive to a determination that the length of the at least one motion vector is above a predetermined high threshold.

14. The non-transitory computer readable medium of claim 9 , wherein computing the second quantization parameter is based in part on

Assignees

• Citrix Systems Inc

Inventors

• Tidemann Jeremy
• Penner Andrew

Classifications

• H04N19/184

  the unit being bits, e.g. of the compressed video stream · CPC title

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• H04N19/136

  Incoming video signal characteristics or properties · CPC title

• H04N19/182

  the unit being a pixel · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title