Enhanced chroma coding using cross plane filtering

Patent metadata

Field	Value
Publication number	US-11438605-B2
Application number	US-201615742836-A
Country	US
Kind code	B2
Filing date	Jul 8, 2016
Priority date	Jul 8, 2015
Publication date	Sep 6, 2022
Grant date	Sep 6, 2022

Abstract

Cross plane filtering may be used for enhanced chroma coding. An indication of a cross-plane filter associated with a current picture may be received. The current picture may include an intra-coded video block and a plurality of reference samples. The plurality of reference samples may be used to predict the intra-coded video block. A luma sample region may be determined in the current picture. The luma sample region may determined to enhance a corresponding chroma sample in the current picture. The cross-plane filter may be applied to a plurality of luma samples in the luma sample region to determine an offset. The cross-plane filter may be a high pass filter. The offset may be applied to the corresponding chroma sample to determine an enhanced chroma sample.

First claim

What is claimed is:

1. A method of video processing, the method comprising:
obtaining a plurality of chroma reference samples used to predict a video block, wherein a current picture comprises the video block;
determining a luma sample region in the current picture for enhancing a corresponding chroma sample, wherein the corresponding chroma sample is in the plurality of chroma reference samples, wherein the luma sample region encompasses at least one of an available luma sample and an unavailable luma sample, and wherein the available luma sample is a reconstructed luma sample;
applying a cross-plane filter to the luma sample region to determine an offset, wherein the cross-plane filter is applied to the luma sample region encompassing the unavailable luma sample, wherein the unavailable luma sample is obtained based on the available luma sample prior to reconstruction of the unavailable luma sample;
applying the offset to the corresponding chroma sample to determine an enhanced chroma sample; and
predicting the video block using the enhanced chroma sample.

2. The method of claim 1 , wherein the unavailable luma sample is obtained based on replacing the unavailable luma sample with padding a neighboring available luma sample prior to applying the cross-plane filter to the luma sample region, and the neighboring available luma sample is the reconstructed luma sample.

3. The method of claim 1 , further comprising determining whether to apply the cross-plane filter based on a chroma enhancement indicator, wherein the chroma enhancement indicator is obtained at a block level.

4. The method of claim 1 , wherein the plurality of chroma reference samples is a first plurality of chroma reference samples, the luma sample region is a first luma sample region, the available luma sample is a first available luma sample, the unavailable luma sample is a first unavailable luma sample, the reconstructed luma sample is a first reconstructed luma sample, the offset is a first offset, the corresponding chroma sample is a first corresponding chroma sample, and the enhanced chroma sample is a first enhanced chroma sample, the method further comprising:
determining a second luma sample region in the current picture for enhancing a second corresponding chroma sample, wherein the second corresponding chroma sample is in a second plurality of chroma reference samples, wherein the second luma sample region encompasses at least one of a second available luma sample and a second unavailable luma sample, and wherein the second available luma sample is a second reconstructed luma sample;
applying the cross-plane filter to the second luma sample region to determine a second offset, wherein the cross-plane filter is applied to the second luma sample region encompassing the second unavailable luma sample, wherein the second unavailable luma sample is obtained based on the second available luma sample prior to the reconstruction of the second unavailable luma sample;
applying the second offset to the second corresponding chroma sample to determine a second enhanced chroma sample; and
predicting the video block using the second enhanced chroma sample.

5. The method of claim 1 , wherein the luma sample region is determined based on at least one of a selected intra prediction mode or a selected inter prediction mode.

6. The method of claim 1 , further comprising determining the cross-plane filter to apply based on at least one of a selected intra prediction mode or a selected inter prediction mode.

7. The method of claim 1 , wherein the corresponding chroma sample is a predicted chroma sample in the video block.

8. The method of claim 1 , wherein the corresponding chroma sample is a reconstructed chroma sample before in-loop filtering, and the enhanced chroma sample is used to replace the corresponding chroma sample before the in-loop filtering is applied.

9. The method of claim 1 , wherein the corresponding chroma sample is a reference chroma sample used to predict one or more samples in the video block.

10. A video processing coding device comprising:
a processor configured to:
obtain a plurality of chroma reference samples used to predict a video block, wherein a current picture comprises the video block;
determine a luma sample region in the current picture for enhancing a corresponding chroma sample, wherein the corresponding chroma sample is associated with in the plurality of chroma reference samples, wherein the luma sample region encompasses at least one of an available luma sample and an unavailable luma sample, and wherein the available luma sample is a reconstructed luma sample;
apply a cross-plane filter to the luma sample region to determine an offset, wherein the cross-plane filter is applied to the luma sample region encompassing the unavailable luma sample, wherein the unavailable luma sample is obtained based on the available luma sample prior to reconstruction of the unavailable luma sample;
apply the offset to the corresponding chroma sample to determine an enhanced chroma sample; and
predict the video block using the enhanced chroma sample.

11. The video processing device of claim 10 , wherein the unavailable luma sample is obtained based on replacing the unavailable luma sample with padding a neighboring available luma sample prior to applying the cross-plane filter to the luma sample region, and the neighboring available luma sample is the reconstructed luma sample.

12. The video processing device of claim 10 , wherein the processor is further configured to determine whether to apply the cross-plane filter based on a chroma enhancement indicator, wherein the chroma enhancement indicator is obtained at a block level.

13. The video processing device of claim 10 , wherein the plurality of chroma reference samples is a first plurality of chroma reference samples, the luma sample region is a first luma sample region, the available luma sample is a first available luma sample, the unavailable luma sample is a first unavailable luma sample, the reconstructed luma sample is a first reconstructed luma sample, the offset is a first offset, the corresponding chroma sample is a first corresponding chroma sample, and the enhanced chroma sample is a first enhanced chroma sample, the processor further configured to:
determine a second luma sample region in the current picture for enhancing a second corresponding chroma sample, wherein the second corresponding chroma sample is in a second plurality of chroma reference samples, wherein the second luma sample region encompasses at least one of a second available luma sample and a second unavailable luma sample, and wherein the second available luma sample is a second reconstructed luma sample;
apply the cross-plane filter to the second luma sample region to determine a second offset, wherein the cross-plane filter is applied to the second luma sample region encompassing the second unavailable luma sample, wherein the second unavailable luma sample is obtained based on the second available luma sample prior to the reconstruction of the second unavailable luma sample;
apply the second offset to the second corresponding chroma sample to determine a second enhanced chroma sample; and
predicting the video block using the second enhanced chroma sample.

14. The video processing device of claim 10 , wherein the processor is further configured to:
determine the cross-plane filter to apply based on at least one of a selected intra prediction mode or a selected inter prediction mode, and
determine the luma sample region based on the at least one of the selected intra prediction mode or the selected inter predicti

Assignees

• Interdigital Madison Patent Holdings Sas

Inventors

• He Yong
• He Yuwen
• Ye Yan
• Xiu Xiaoyu

Classifications

• H04N19/82

  involving filtering within a prediction loop · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title

• H04N19/117 Primary

  Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) · CPC title

• H04N19/186 Primary

  the unit being a colour or a chrominance component · CPC title

• H04N19/80

  Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) · CPC title