Video quality assessment at a bitstream level

Patent metadata

Field	Value
Publication number	US-9769501-B2
Application number	US-201214405079-A
Country	US
Kind code	B2
Filing date	Jul 17, 2012
Priority date	Jul 17, 2012
Publication date	Sep 19, 2017
Grant date	Sep 19, 2017

Abstract

A macroblock in a video sequence may be undecodable because the corresponding compressed data is lost or the syntax is out of synchronization. An undecodable macroblock may be concealed using error concealment technique. The level of initial visible artifacts caused by undecodable macroblocks may be estimated as a function of motion magnitude, error concealment distance, and/or residual energy. The initial visible artifacts may propagate spatially or temporally to other macroblocks through prediction. Considering both initial visible artifacts and propagated artifacts, levels of overall artifacts may be estimated for individual macroblocks. The visual quality for the video sequence can then be estimated by pooling the macroblock level artifact levels.

First claim

The invention claimed is:

1. A method for estimating visual quality of a video sequence represented by a bitstream, wherein slicing mode error concealment is used to conceal undecodable blocks in the video sequence, comprising:
determining a magnitude of a motion vector of a block, in a frame of the video sequence, that is undecodable;
determining a distance between the frame and another frame that is used to conceal the block, wherein the magnitude of the motion vector and the distance are estimated at a bitstream level;
determining an initial visible artifact level in response to a product of the magnitude of the motion vector and the distance; and
estimating the visual quality of the video sequence in response to the initial visible artifact level.

2. The method of claim 1 , further comprising:
estimating residual energy of the block, wherein the initial visible artifact level is determined further in response to the residual energy.

3. The method of claim 2 , wherein the initial visible artifact level is determined in response to a smaller one of (1) a function of the motion magnitude and the distance and (2) another function of the residual energy, wherein the function of the motion magnitude and the distance is an increasing function of the product of the motion magnitude and the distance, and wherein the function of the residual energy is an increasing function of the residual energy.

4. The method of claim 2 , wherein the determining an initial visible artifact level is responsive to only a function of the motion magnitude and the distance for a high bitrate application, and is responsive to both (1) the function of the motion magnitude and the distance and (2) another function of the residual energy for a low bitrate application.

5. The method of claim 1 , further comprising:
determining a propagated visible artifact level for a pixel in the block in response to an artifact level for a pixel in another block that is used as a reference block for the block;
determining an artifact level for the pixel in the block in response to the propagated visible artifact level for the pixel in the block; and
estimating an overall visible artifact level for the block in response to the artifact level for the pixel in the block, wherein the visual quality of the video sequence is estimated in response to the overall visible artifact level for the block.

6. The method of claim 5 , wherein the overall visible artifact level for the block is estimated in response to an average of artifact levels for pixels in the block.

7. The method of claim 5 , wherein the determining the artifact level for the pixel in the block is further in response to the initial visible artifact level for the block.

8. The method of claim 7 , wherein the artifact level for the pixel in the block is determined in response to a greater one of the initial visible artifact level and the propagated visible artifact level.

9. An apparatus for estimating visual quality of a video sequence represented by a bitstream, wherein slicing mode error concealment is used to conceal undecodable blocks in the video sequence, comprising at least a memory and one or more processors, the one or more processors configured to:
determine a magnitude of a motion vector of an undecodable block in a frame of the video sequence, and a distance between the frame and another frame that is used to conceal the undecodable block wherein the magnitude of the motion vector and the distance are determined at a bitstream level;
determine an initial visible artifact level in response to a product of the magnitude of the motion vector and the distance; and
estimate the visual quality of the video sequence in response to the initial visible artifact level.

10. The apparatus of claim 9 , wherein the one or more processors are further configured to estimate residual energy of the block, and to determine the initial visible artifact level further in response to the residual energy.

11. The apparatus of claim 10 , wherein the one or more processors are configured to determine the initial visible artifact level in response to a smaller one of (1) a function of the motion magnitude and the distance and (2) another function of the residual energy, wherein the function of the motion magnitude and the distance is an increasing function of the product of the motion magnitude and the distance, and wherein the function of the residual energy is an increasing function of the residual energy.

12. The apparatus of claim 10 , wherein the one or more processors are configured to determine the initial visible artifact level only responsive to a function of the motion magnitude and the distance for a high bitrate application, and responsive to both (1) the function of the motion magnitude and the distance and (2) another function of the residual energy for a low bitrate application.

13. The apparatus of claim 9 , wherein the one or more processors are further
configured to determine a propagated visible artifact level for a pixel in the block in response to an artifact level for a pixel in another block that is used as a reference block for the block, to determine an artifact level for the pixel in the block in response to the propagated visible artifact level for the pixel in the block, and to estimate an overall visible artifact level for the block in response to the artifact level for the pixel in the block.

14. The apparatus of claim 13 , wherein the one or more processors are configured to estimate the overall visible artifact level for the block in response to an average of artifact levels for pixels in the block.

15. The apparatus of claim 13 , wherein the artifact level for the pixel in the block is further determined in response to the initial visible artifact level for the block.

16. The apparatus of claim 15 , wherein the one or more processors are configured to determine the artifact level for the pixel in the block in response to a greater one of the initial visible artifact level and the propagated visible artifact level.

Assignees

• Liao Ning
• Chen Zhibo
• Xie Kai
• Thomson Licensing

Inventors

• Liao Ning
• Chen Zhibo
• Xie Kai

Classifications

• H04N19/177

  the unit being a group of pictures [GOP] · CPC title

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• H04N19/89

  involving methods or arrangements for detection of transmission errors at the decoder · CPC title

• H04N19/184

  the unit being bits, e.g. of the compressed video stream · CPC title

• H04N19/44

  Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder · CPC title