Method and apparatus for residual prediction in three-dimensional video coding

Patent metadata

Field	Value
Publication number	US-9648342-B2
Application number	US-201314442951-A
Country	US
Kind code	B2
Filing date	Nov 14, 2013
Priority date	Nov 14, 2012
Publication date	May 9, 2017
Grant date	May 9, 2017

Abstract

A method and apparatus using pseudo residues to predict current residues for three-dimensional or multi-view video coding are disclosed. The method first receives input data associated with a current block of a current picture in a current dependent view and determines an inter-view reference block in a first inter-view reference picture in a reference view according to a DV (disparity vector), where the current picture and the first inter-view reference picture correspond to same time instance. Pseudo residues are then determined and used for encoding or decoding of the current block, where the pseudo residues correspond to differences between a corresponding region in an inter-time reference picture in the current dependent view and a pseudo reference region in a pseudo reference picture in the reference view, and where the inter-time reference picture and the pseudo reference picture correspond to same time instance.

First claim

The invention claimed is:

1. A method for three-dimensional or multi-view video coding, the method comprising:
receiving input data associated with a current block of a current picture in a current dependent view;
determining an inter-view reference block in a first inter-view reference picture in a reference view according to a DV (disparity vector), wherein the current picture and the first inter-view reference picture correspond to same time instance;
determining first pseudo residues, wherein the first pseudo residues correspond to first differences between a corresponding region in an inter-time reference picture in the current dependent view and a pseudo reference region in a pseudo reference picture in the reference view, and wherein the inter-time reference picture and the pseudo reference picture correspond to same time instance; and
applying encoding or decoding to the input data associated with the current block based on the inter-view reference block and the first pseudo residues.

2. The method of claim 1 , wherein first residues are determined based on second differences between the current block and the inter-view reference block, final residues are generated from the first residues by predicting the first residues using the first pseudo residues, and the encoding or decoding is applied to the final residues.

3. The method of claim 1 , wherein the inter-view reference block and the first pseudo residues are combined to form a combined predictor, final residues are generated from the current block by predicting the current block using the combined predictor, and the encoding or decoding is applied to the final residues.

4. The method of claim 3 , wherein the combined predictor is processed by clipping to form a clipped predictor and the final residues are generated from the current block by predicting the current block using the clipped predictor.

5. The method of claim 1 , wherein the first pseudo residues are processed using a linear function or a non-linear function before said applying encoding or decoding to the input data associated with the current block based on the inter-view reference block and the first pseudo residues.

6. The method of claim 1 , wherein the DV is used to locate the pseudo reference region in the pseudo reference picture in the reference view based on the corresponding region in the inter-time reference picture in the current dependent view.

7. The method of claim 1 , wherein an estimated MV (Motion Vector) is used to locate the corresponding region within the inter-time reference picture in the current dependent view based on the current block of the current picture in the current dependent view.

8. The method of claim 7 , wherein the estimated MV is derived based on previously coded spatial and temporal neighboring blocks of the current block, wherein if a candidate MV associated with the spatial and temporal neighboring blocks of the current block refers to the inter-time reference picture in the current dependent view, the candidate MV is selected as the estimated MV.

9. The method of claim 7 , wherein the estimated MV is selected based on evaluation results of applying an evaluation function to a plurality of candidate MVs determined from MVs associated with neighboring blocks of the current block.

10. The method of claim 7 , wherein an index associated with a candidate MV that is selected as the estimated MV is transmitted in a MB (Macroblock) level, CU (Coding Unit) level or PU (Prediction Unit) level of a video bitstream.

11. The method of claim 7 , wherein an index associated with a candidate MV that is selected as the estimated MV is determined implicitly at a decoder side.

12. The method of claim 1 , wherein said applying encoding or decoding to the input data associated with the current block based on the inter-view reference block and the first pseudo residues is enabled or disabled for a slice, MB (Macroblock), CU (Coding Unit) or PU (Prediction Unit) depending on an indication transmitted in a corresponding slice level, MB level, CU level or PU level of a video bitstream.

13. The method of claim 1 , wherein said applying encoding or decoding to the input data associated with the current block based on the inter-view reference block and the first pseudo residues is enabled or disabled implicitly for a slice, MB (Macroblock), CU (Coding Unit) or PU (Prediction Unit) depending on a specific coding mode for the slice, MB, CU or PU.

14. The method of claim 1 , wherein said applying encoding or decoding to the input data associated with the current block based on the inter-view reference block and the first pseudo residues is enabled for a slice, MB (Macroblock), CU (Coding Unit) or PU (Prediction Unit) coded in Merge/Skip mode or enabled for the slice, MB, CU or PU using an inter-view Merge candidate in a temporal direction.

15. The method of claim 1 , wherein said applying encoding or decoding to the input data associated with the current block is further based on second pseudo residues, wherein derivation of the second pseudo residues is associated with a second inter-view reference picture in the reference view, and wherein the first inter-view reference picture and the second inter-view reference picture are in different reference picture lists.

16. An apparatus for three-dimensional or multi-view video coding, the apparatus comprising one or more electronic circuits, wherein said one or more electronic circuits are configured to:
receive input data associated with a current block of a current picture in a current dependent view;
determine an inter-view reference block in a first inter-view reference picture in a reference view according to a DV (disparity vector), wherein the current picture and the first inter-view reference picture correspond to same time instance;
determine pseudo residues, wherein the pseudo residues correspond to first differences between a corresponding region in an inter-time reference picture in the current dependent view and a pseudo reference region in a pseudo reference picture in the reference view, and wherein the inter-time reference picture and the pseudo reference picture correspond to same time instance; and
apply encoding or decoding to the input data associated with the current block based on the inter-view reference block and the pseudo residues.

Assignees

• Hfi Innovation Inc

Inventors

• Zhang Kai
• An Jicheng
• Lin Jian-Liang

Classifications

• H04N19/172

  the region being a picture, frame or field · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/52 Primary

  by predictive encoding · CPC title

• H04N19/174

  the region being a slice, e.g. a line of blocks or a group of blocks · CPC title

• H04N19/14

  Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) · CPC title