Cross-layer cross-channel residual prediction

Patent metadata

Field	Value
Publication number	US-10536710-B2
Application number	US-201213977664-A
Country	US
Kind code	B2
Filing date	Jun 27, 2012
Priority date	Jun 27, 2012
Publication date	Jan 14, 2020
Grant date	Jan 14, 2020

Abstract

Systems, apparatus and methods are described including operations for video coding including cross-layer cross-channel residual prediction.

First claim

What is claimed:

1. A computer-implemented method for video coding, comprising:
determining, via a video coder, a reference prediction residual by residual prediction for a reference color channel in a reference layer of video data; and
determining, via the video coder, a target prediction residual for a target color channel in a target layer based at least in part on the reference prediction residual via cross-layer cross-color-channel residual prediction, wherein the target layer is a higher layer than the reference layer, and wherein the target color channel is only a different color channel than the reference color channel so that the target color channel of type A from an ABC color scheme is associated with the reference color channels of type B and/or type C but not type A from the ABC color scheme.

2. The method of claim 1 , wherein when the reference layer comprises a base layer, the target layer comprises an enhancement layer; and wherein when the reference layer comprises an enhancement layer, the target layer comprises a higher enhancement layer.

3. The method of claim 1 , wherein when the reference color channel comprises a luma color channel, the target color channel comprises a chroma color channel; and wherein when the reference channel comprises a chroma color channel, the target color channel comprises one of a luma color channel or another chroma color channel.

4. The method of claim 1 , further comprising:
determining, via the video coder, a further reference prediction residual for a further reference layer and/or for a further reference color channel of the video data.

5. The method of claim 1 , further comprising:
determining, via the video coder, a further reference prediction residual for a further reference layer and/or for a further reference color channel of the video data,
wherein the determination, via the video coder, of the target prediction residual for the target color channel in the target layer is based at least in part on the further reference prediction residual in addition to the reference prediction residual, and
wherein the target layer is a higher layer than the further reference layer and/or the target color channel is a different color channel than the further reference color channel.

6. The method of claim 1 , further comprising:
reconstructing, via the video coder, a first-order-type reference prediction residual from a second-order-type reference prediction residual, and
wherein the determination, via the video coder, of the target prediction residual for the target color channel in the target layer is based at least in part on the reconstructed first-order-type reference prediction residual.

7. The method of claim 1 , further comprising:
determining, via the video coder, a further reference prediction residual for a further reference layer and/or for a further reference color channel of the video data; and
reconstructing, via the video coder, a first-order-type reference prediction residual from a second-order-type reference prediction residual of the further reference prediction residual based at least in part on the reference prediction residual,
wherein the determination, via the video coder, of the target prediction residual for the target color channel in the target layer is based at least in part on the reconstructed first-order-type reference prediction residual of the further reference prediction residual, and
wherein the target layer is a higher layer than the further reference layer and/or the target color channel is a different color channel than the further reference color channel.

8. The method of claim 1 , wherein the determination, via the video coder, of the target prediction residual for the target color channel in the target layer comprises selection of the reference layer and reference color channel during decoding based at least in part on a flag associated with the target prediction residual during encoding.

9. The method of claim 1 , wherein determining the target prediction residual comprises applying one of a linear relation model or a non-linear relation model.

10. The method of claim 1 , wherein determining the target prediction residual comprises adaptively applying one of a linear relation model or a non-linear relation model in response to an encoding mode and/or in response to a block size on a block-by-block basis.

11. The method of claim 1 , wherein determining the target prediction residual comprises applying one of a linear relation model or a non-linear relation model, wherein determining the target prediction residual comprises adaptively applying one of a one or more fixed relation model parameters or adaptively determining one or more relation model parameters in response to an encoding mode and/or in response to a block size on a block-by-block basis.

12. The method of claim 1 , wherein determining the target prediction residual comprises adaptively applying one of a linear relation model or a non-linear relation model in response to an encoding mode and/or in response to a block size on a block-by-block basis, wherein determining the target prediction residual comprises adaptively applying one of a one or more fixed relation model parameters or adaptively determining one or more relation model parameters in response to an encoding mode and/or in response to a block size on a block-by-block basis.

13. The method of claim 1 , wherein the determination, via the video coder, of the target prediction residual for the target color channel via cross-layer cross-color-channel residual prediction is adaptively applied a block-by-block basis based at least in part on a rate distortion cost.

14. The method of claim 1 , further comprising:
determining, via the video coder, a further reference prediction residual for a further reference layer and/or for a further reference color channel of the video data,
wherein the determination, via the video coder, of the target prediction residual for the target color channel in the target layer is based at least in part on the further reference prediction residual in addition to the reference prediction residual,
wherein the target layer is a higher layer than the further reference layer and/or the target color channel is a different color channel than the further reference color channel,
wherein when the reference layer comprises a base layer, the target layer comprises an enhancement layer; and wherein when the reference layer comprises an enhancement layer, the target layer comprises a higher enhancement layer,
wherein when the reference color channel comprises a luma color channel, the target color channel comprises a chroma color channel; and wherein when the reference color channel comprises a chroma color channel, the target color channel comprises one of a luma color channel or another chroma color channel,
wherein determining the target prediction residual comprises adaptively applying one of a linear relation model or a non-linear relation model in response to an encoding mode and/or in response to a block size on a block-by-block basis,
wherein determining the target prediction residual comprises adaptively applying one of a one or more fixed relation model parameters or adaptively determining one or more relation model parameters in response to an encoding mode and/or in response to a block size on a block-by-block basis,
wherein the determination, via the video coder, of the target prediction residual for the target color channel via cross-layer cross-color-channel residual prediction is adaptively applied a block-by-block basis based at least in part on a rate distortion cost, and
wherein the det

Assignees

• Xu Lidong
• Han Yu
• Zhang Wenhao
• Chiu Yi Jen
• Jiang Hong
• Intel Corp

Inventors

• Xu Lidong
• Han Yu
• Zhang Wenhao
• Chiu Yi-Jen
• Jiang Hong

Classifications

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N19/573

  Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction · CPC title

• H04N19/105

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/187

  the unit being a scalable video layer · CPC title

• H04N19/147

  according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567) · CPC title