Inter prediction method and apparatus

Patent metadata

Field	Value
Publication number	US-12058362-B2
Application number	US-202117389873-A
Country	US
Kind code	B2
Filing date	Jul 30, 2021
Priority date	Feb 1, 2019
Publication date	Aug 6, 2024
Grant date	Aug 6, 2024

Abstract

The inter prediction method is provided, which includes: obtaining a predicted sample value of a current affine block; determining one or more luminance compensation blocks based on motion vectors of one or more subblocks of the current affine block; determining a linear model coefficient based on a first sample set and a second sample set, where the first sample set includes at least one reconstructed sample neighboring to an edge of the current affine block, the second sample set includes at least one reconstructed sample neighboring to an edge of the one or more luminance compensation blocks, and the sample in the first sample set is in a one-to-one correspondence with the sample in the second sample set; and updating the predicted sample value of the current affine block based on the linear model coefficient, to obtain an updated predicted sample value of the current affine block.

First claim

What is claimed is:

1. A method, comprising:
obtaining a predicted sample value of a current affine block;
determining one or more luminance compensation blocks based on motion vectors of one or more subblocks of the current affine block;
determining a linear model coefficient based on a first sample set and a second sample set, wherein the first sample set comprises at least one reconstructed sample neighboring to an edge of the current affine block, the second sample set comprises at least one reconstructed sample neighboring to an edge of the one or more luminance compensation blocks, and each sample in the first sample set is in a one-to-one correspondence with a corresponding sample in the second sample set, wherein the second sample set comprises a reconstructed sample at a specific neighboring location of each of the one or more luminance compensation blocks, the one or more luminance compensation blocks comprise one or more of a first-type luminance compensation block and a second-type luminance compensation block, the first-type luminance compensation block comprises a luminance compensation block corresponding to a subblock on an upper edge of the current affine block, the second-type luminance compensation block comprises a luminance compensation block corresponding to a subblock on a left edge of the current affine block; and
updating the predicted sample value of the current affine block based on the linear model coefficient, to obtain an updated predicted sample value of the current affine block.

2. The method of claim 1 , wherein determining the one or more luminance compensation blocks based on the motion vectors of the one or more subblocks of the current affine block comprises:
determining, based on a corresponding motion vector of each of the one or more subblocks of the current affine block, a luminance compensation block corresponding to each subblock, to obtain the one or more luminance compensation blocks.

3. The method of claim 2 , wherein the first sample set comprises one or more of a reconstructed sample neighboring to the left edge and a reconstructed sample neighboring to the upper edge of the current affine block.

4. The method of claim 2 , wherein a reconstructed sample at a specific neighboring location of the first-type luminance compensation block comprises a reconstructed sample neighboring to an upper edge of the first-type luminance compensation block, and a reconstructed sample at a specific neighboring location of the second-type luminance compensation block comprises a reconstructed sample neighboring to a left edge of the second-type luminance compensation block.

5. The method of claim 1 , wherein determining the one or more luminance compensation blocks based on the motion vectors of the one or more subblocks of the current affine block comprises:
determining, based on a first motion vector of a first subblock at a first preset location in the current affine block, a luminance compensation block corresponding to the current affine block.

6. The method of claim 5 , wherein the first preset location is an upper-left corner or a center of the current affine block.

7. The method of claim 5 , wherein the first sample set comprises one or more of a reconstructed sample neighboring to a left edge and a reconstructed sample neighboring to an upper edge of the current affine block, and the second sample set comprises one or more of a reconstructed sample neighboring to a left edge and a reconstructed sample neighboring to an upper edge of the luminance compensation block corresponding to the current affine block.

8. The method of claim 1 , wherein determining the one or more luminance compensation blocks based on the motion vectors of the one or more subblocks of the current affine block comprises:
determining, based on a second motion vector of a second subblock at a second preset location in the current affine block, a luminance compensation block corresponding to the subblock at the second preset location.

9. The method of claim 8 , wherein the second preset location is one or more of a left edge and an upper edge of the current affine block, the first sample set comprises a reconstructed sample neighboring to one or more of a left edge and a reconstructed sample neighboring to an upper edge of the subblock at the second preset location, and the second sample set comprises one or more of a reconstructed sample neighboring to a left edge and a reconstructed sample neighboring to an upper edge of the luminance compensation block corresponding to the subblock at the second preset location.

10. The method of claim 8 , wherein the second preset location is an upper-left corner of the current affine block, the first sample set comprises one or more of a reconstructed sample neighboring to a left edge and a reconstructed sample neighboring to an upper edge of the subblock at the second preset location, and the second sample set comprises one or more of a reconstructed sample neighboring to a left edge and a reconstructed sample neighboring to an upper edge of the luminance compensation block corresponding to the subblock at the second preset location.

11. The method of claim 1 , wherein the method is a video decoding method, and before the determining the one or more luminance compensation blocks based on the motion vectors of the one or more subblocks of the current affine block, the method further comprises:
decoding a bitstream to obtain first identification information, wherein the first identification information indicates that luminance compensation will be performed on the current affine block.

12. The method of claim 1 , wherein the updated predicted sample value of the current affine block is obtained based:
pred_ c ( i,j )=α× rec _ c ( i,j )+β, wherein

pred_c(i, j) is an updated predicted sample value at a location (i, j) in the current affine block, rec_c(i, j) is a predicted sample value at the location (i, j) in the current affine block, and α and β are linear model coefficients.

13. A video coding device, comprising:
a memory containing instructions; and
a processor in communication with the memory and upon execution of the instructions, is configured to:
obtain a predicted sample value of a current affine block;
determine one or more luminance compensation blocks based on motion vectors of one or more subblocks of the current affine block;
determine a linear model coefficient based on a first sample set and a second sample set, wherein the first sample set comprises at least one reconstructed sample neighboring to an edge of the current affine block, the second sample set comprises at least one reconstructed sample neighboring to an edge of the one or more luminance compensation blocks, and each sample in the first sample set is in a one-to-one correspondence with a corresponding sample in the second sample set, wherein the second sample set comprises a reconstructed sample at a specific neighboring location of each of the one or more luminance compensation blocks, the one or more luminance compensation blocks comprise one or more of a first-type luminance compensation block and a second-type luminance compensation block, the first-type luminance compensation block comprises a luminance compensation block corresponding to a subblock on an upper edge of the current affine block, the second-type luminance compensation block comprises a luminance compensation block corresponding to a subblock on a left edge of the current affine block; and
update the predicted sample value of the current affine block based on the linear model coefficient, to obtain an updated predicted sample value of the current affine block

Assignees

• Huawei Tech Co Ltd

Inventors

• Yang Haitao
• Mu Fan
• Ma Xiang
• Chen Huanbang
• Zhang Lian

Classifications

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/159

  Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title

• H04N19/105

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title