Video coding using multi-model linear model

Patent metadata

Field	Value
Publication number	US-2022360799-A1
Application number	US-202017438334-A
Country	US
Kind code	A1
Filing date	Mar 11, 2020
Priority date	Mar 12, 2019
Publication date	Nov 10, 2022
Grant date	—

Abstract

A computing device performs a method of decoding video data by receiving bitstream encoding a chroma block, a corresponding luma block, neighboring luma samples, and neighboring chroma samples; decoding the luma block, the plurality of neighboring luma samples, and the plurality of neighboring chroma samples; selecting a group of reference luma samples and a group of reference chroma samples; computing a threshold luma value from the plurality of reconstructed neighboring luma samples, and a threshold chroma value from the plurality of reconstructed neighboring chroma samples; determining a maximum luma value and a minimum luma value from the group of the reference luma samples; generating multi-model linear model (MMLM) including a first linear model between the minimum luma value and the threshold luma value, and a second linear model between the threshold luma value and the maximum luma value; and reconstructing the chroma block from the luma block using MMLM.

First claim

1 - 12 . (canceled)

13 . A method for reconstructing a chroma block of a video signal, comprising:
receiving bitstream encoding the chroma block, a corresponding luma block, a plurality of neighboring luma samples surrounding the luma block, and a plurality of neighboring chroma samples surrounding the chroma block; decoding the luma block, the plurality of neighboring luma samples, and the plurality of neighboring chroma samples to obtain a plurality of reconstructed luma samples of the luma block, a plurality of reconstructed neighboring luma samples, and a plurality of reconstructed neighboring chroma samples, respectively; selecting, from the plurality of reconstructed neighboring luma samples and the plurality of reconstructed neighboring chroma samples, a group of reference luma samples and a group of reference chroma samples, wherein each reference luma sample corresponds to a respective reference chroma sample; computing a threshold luma value from the plurality of reconstructed neighboring luma samples, and a threshold chroma value from the plurality of reconstructed neighboring chroma samples; determining a maximum luma value and a minimum luma value from the group of the reference luma samples, wherein the threshold luma value is between the minimum luma value and the maximum luma value; generating a multi-model linear model including a first linear model between the minimum luma value and the threshold luma value, and a second linear model between the threshold luma value and the maximum luma value; and reconstructing the chroma block from the luma block using the multi-model linear model.

14 . The method of claim 13 , wherein generating the multi-model linear model includes:
determining a first chroma value of a first reference chroma sample corresponding to a first reference luma sample having the maximum luma value, and a second chroma value of a second reference chroma sample corresponding to a second reference luma sample having the minimum luma value; and wherein the first linear model connects (minimum luma value, first chroma value) and (threshold luma value, threshold chroma value) and the second linear model connects (threshold luma value, threshold chroma value) and (maximum luma value, second chroma value).

15 . The method of claim 13 , wherein reconstructing the chroma block from the luma block using the multi-model linear model includes:
for a respective chroma sample in the chroma block:
determining a respective luma value of a respective luma sample in a decoded luma block that corresponds to a respective chroma sample;
in accordance with a determination that the respective luma value is smaller than or equal to the threshold luma value: applying the first linear model to the respective luma value to obtain a respective chroma value; and
in accordance with a determination that the respective luma value is greater than or equal to the threshold luma value: applying the second linear model to the respective luma value to obtain a respective chroma value.

16 . The method of claim 13 , wherein computing the threshold luma value includes finding an average luma value from the plurality of reconstructed neighboring luma samples, and computing the threshold chroma value includes finding an average chroma value from the plurality of reconstructed neighboring chroma samples.

17 . The method of claim 13 , wherein selecting the group of reference luma samples and the group of chroma reference samples includes determining an upper limit of a number of reference luma samples and reference chroma samples to be used.

18 . The method of claim 13 , where selecting the group of reference luma samples and the group of reference chroma samples includes selecting every other luma samples from the plurality of reconstructed neighboring luma samples and every other chroma samples from the plurality of reconstructed neighboring chroma samples.

19 . The method of claim 13 , further including:
computing a second threshold luma value greater than the threshold luma value and a corresponding second threshold chroma value greater than the threshold chroma value, and wherein:
the second linear model is applicable to luma values between the threshold luma value and the second threshold luma value, and
a third linear model is applicable luma values between the second threshold luma value and the maximum luma value.

20 . The method of claim 13 , wherein computing the threshold luma value includes finding a weighted average luma value between the maximum luma value and the minimum luma value from the plurality of reconstructed neighboring luma samples, and computing the threshold chroma value includes finding a weighted average chroma value between the maximum chroma value and the minimum chroma value from the plurality of reconstructed neighboring chroma samples.

21 . The method of claim 13 , wherein computing the threshold luma value includes finding an average luma value from the plurality of reconstructed luma samples of the luma block.

22 . The method of claim 13 , wherein reconstructing the chroma block from the luma block using the multi-model linear model includes:
for a respective block of chroma samples in the chroma block:
determining a respective average luma value of a respective block of luma samples in a decoded luma block that corresponds to a respective block of chroma samples;
in accordance with a determination that the respective average luma value is smaller than or equal to the threshold luma value: applying the first linear model to each luma value in the respective block of luma samples to obtain a respective chroma value in the respective block of chroma samples; and
in accordance with a determination that the respective average luma value is greater than the threshold luma value: applying the second linear model to each luma value in the respective block of luma samples to obtain a respective chroma value in the respective block of chroma samples.

23 . A computing device including one or more processors, memory and a plurality of programs stored in the memory, wherein the programs, when executed by the one or more processors, cause the computing device to perform operations including:
receiving bitstream encoding the chroma block, a corresponding luma block, a plurality of neighboring luma samples surrounding the luma block, and a plurality of neighboring chroma samples surrounding the chroma block;
decoding the luma block, the plurality of neighboring luma samples, and the plurality of neighboring chroma samples to obtain a plurality of reconstructed luma samples of the luma block, a plurality of reconstructed neighboring luma samples, and a plurality of reconstructed neighboring chroma samples, respectively;
selecting, from the plurality of reconstructed neighboring luma samples and the plurality of reconstructed neighboring chroma samples, a group of reference luma samples and a group of reference chroma samples, wherein each reference luma sample corresponds to a respective reference chroma sample;
computing a threshold luma value from the plurality of reconstructed neighboring luma samples, and a threshold chroma value from the plurality of reconstructed neighboring chroma samples;
determining a maximum luma value and a minimum luma value from the group of the reference luma samples, wherein the threshold luma value is between the minimum luma value and the maximum luma value;
generating a multi-model linear model including a first linear model between the minimum luma value and the threshold luma value, and a second linear model between the threshold luma value and the maximum luma value; and
reconstructing the chroma

Assignees

• Wang Xianglin
• Beijing Dajia Internet Information Tech Co Ltd

Inventors

• Wang Xianglin
• Jhu Hong-Jheng
• Chen Yi-Wen

Classifications

• H04N19/186 Primary

  the unit being a colour or a chrominance component · CPC title

• H04N19/182

  the unit being a pixel · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/42

  characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation (H04N19/635 takes precedence) · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title