Method of Background Residual Prediction for Video Coding

Patent metadata

Field	Value
Publication number	US-2016150242-A1
Application number	US-201414548304-A
Country	US
Kind code	A1
Filing date	Nov 20, 2014
Priority date	Dec 13, 2013
Publication date	May 26, 2016
Grant date	—

Abstract

A method and apparatus for video encoding or decoding utilizing adaptive background residual prediction is disclosed. The present invention adaptively applies background residual prediction to a current block based on a selection decision. The coding block is split into one or more coding sub-blocks. A reference sub-block in a reference picture is located for a current coding sub-block of the current coding block according to a motion vector associated with the current coding block. A background reference sub-block in a background picture is located for the reference sub-block, where the background reference sub-block is at a first co-located location as the reference sub-block. The method then selects a first predictor or a second predictor to encode or decode the current sub-block based on a selection decision. The first predictor corresponds to the reference sub-block, and the second predictor is derived according to the reference sub-block and the background picture.

First claim

1 . A method of video encoding or decoding utilizing adaptive background residual prediction, the method comprising:
receiving input data associated with a current coding block in a current picture; splitting the current coding block into one or more coding sub-blocks; locating a reference sub-block in a reference picture for a current sub-block of the current coding block according to a motion vector associated with the current coding block; locating a background reference sub-block in a background picture for the reference sub-block, wherein the background reference sub-block is at a first co-located location as the reference sub-block; and selecting a first predictor or a second predictor to encode or decode the current sub-block based on a selection decision, wherein the first predictor corresponds to the reference sub-block and the second predictor is derived according to the reference sub-block and the background picture.

2 . The method of claim 1 , wherein the background picture is generated based on one or more decoded pictures.

3 . The method of claim 1 , wherein the selection decision is derived based on the reference sub-block and the background reference sub-block.

4 . The method of claim 3 , wherein a sum of absolute differences (SAD) or a mean squared error (MSE) between the reference sub-block and the background reference sub-block is derived, and the first predictor is selected if the SAD or the MSE is greater than a threshold and the second predictor is selected if the SAD or the MSE is smaller than the threshold.

5 . The method of claim 3 , wherein absolute differences between the reference sub-block and the background reference sub-block are derived, the first predictor is selected if a number of absolute differences exceeding a threshold is larger than a selected number and the second predictor is selected otherwise, and wherein the selected number corresponds to a non-negative integer.

6 . The method of claim 1 , wherein the selection decision is indicated by a flag.

7 . The method of claim 1 , further comprising incorporating a syntax element in an encoder side or parsing the syntax element in a decoder side, wherein the syntax element indicates whether to enable adaptive background residual prediction.

8 . The method of claim 7 , wherein the syntax element is incorporated in a picture level or a slice header level of a video bitstream to control selection of the adaptive background residual prediction for a respective picture or slice.

9 . The method of claim 7 , wherein the syntax element is incorporated in coded data for the current coding block to control selection of the adaptive background residual prediction for the current coding block.

10 . The method of claim 9 , wherein said incorporating the syntax element in the encoder side and said parsing the syntax element in the decoder side are skipped for the current coding block if the current coding block is coded using Merge mode or Skip mode.

11 . The method of claim 9 , wherein said incorporating the syntax element in the encoder side and said parsing the syntax element in the decoder side are skipped for the current coding block if the current coding block is predicted using prediction units smaller than the current coding block.

12 . The method of claim 9 , wherein said incorporating the syntax element in the encoder side and said parsing the syntax element in the decoder side are skipped for the current coding block if width or height of the current coding block is equal to or smaller than a selected size, wherein the selected size corresponds to a positive integer.

13 . The method of claim 12 , wherein the selected size is eight or sixteen.

14 . The method of claim 1 , wherein width of the current sub-block is from 1 to picture width and height of the current sub-block is from 1 to picture height.

15 . The method of claim 1 , wherein the second predictor corresponds to a linear combination of the reference sub-block, the background reference sub-block and a background current sub-block in the background picture, and wherein the background current sub-block is at a second co-located location as the current sub-block.

16 . The method of claim 15 , wherein the second predictor is set to a sum of a reference residual and the background current sub-block, and wherein the reference residual is derived by subtracting the background reference sub-block from the reference sub-block.

17 . The method of claim 1 , wherein the motion vector associated with the current coding block is derived in a picture domain or a background residual domain, wherein the current picture and the reference picture are used to derive the motion vector for the picture domain, and current background residual data and reference background residual data are used to derive the motion vector for the background residual domain, the current background residual data corresponds to first differences between the current picture and the background picture, and the reference background residual data corresponds to second differences between the reference picture and the background picture.

18 . An apparatus for video encoding or decoding utilizing adaptive background residual prediction, the apparatus comprising one or more electronic circuits configured to:
receive input data associated with a current coding block in a current picture; split the current coding block into one or more coding sub-blocks; locate a reference sub-block in a reference picture for a current sub-block of the current coding block according to a motion vector associated with the current coding block; locate a background reference sub-block in a background picture for the reference sub-block, wherein the background reference sub-block is at a first co-located location as the reference sub-block; and select a first predictor or a second predictor to encode or decode the current sub-block based on a selection decision, wherein the first predictor corresponds to the reference sub-block and the second predictor is derived according to the reference sub-block and the background picture.

19 . A method of video encoding or decoding utilizing adaptive background residual prediction, the method comprising:
receiving input data associated with a current coding block in a current picture; splitting the current coding block into one or more coding sub-blocks; locating a reference sub-block in a reference picture for a current sub-block of the current coding block according to a motion vector associated with the current coding block; locating a background reference sub-block in a background picture for the reference sub-block, wherein the background reference sub-block is at a first co-located location as the reference sub-block; locating a background current sub-block in a background picture, wherein the background current sub-block is at a second co-located location as the current sub-block; calculating a predictor for the current sub-block according to the reference sub-block, the background reference sub-block, and the background current sub-block; and encoding or decoding the current sub-block using the predictor.

20 . The method of claim 19 , further comprising incorporating a syntax element in an encoder side or parsing the syntax element in a decoder side, wherein the syntax element indicates whether to enable adaptive background residual prediction.

21 . The method of claim 19 , wherein the predictor is set to a sum of a reference residual and the backgro

Assignees

• Mediatek Singapore Pte Ltd

Inventors

• Zhang Xianguo
• Zhang Kai
• An Jicheng

Classifications

• H04N19/105 Primary

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/46

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/147

  according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567) · CPC title