Motion compensation method and module, chip, electronic device and storage media

Patent metadata

Field	Value
Publication number	US-11638031-B2
Application number	US-202117304920-A
Country	US
Kind code	B2
Filing date	Jun 28, 2021
Priority date	Jun 30, 2020
Publication date	Apr 25, 2023
Grant date	Apr 25, 2023

Abstract

The present disclosure relates to a motion compensation method and module, a chip, an electronic device, and a storage medium, to improve the problem of haloes easily appearing on the edges of moving objects.

First claim

What is claimed is:

1. A motion compensation method, comprising:
determining whether a current block is located at a junction of a foreground and a background;
in response to a determination that the current block is located at the junction of the foreground and the background, marking the current block as a target block, a motion vector of the target block being a basic motion vector;
obtaining a first set of motion vectors based on differences between motion vectors of a first central block of the target block pointing to a previous frame within a search range and the basic motion vector;
obtaining a second set of motion vectors based on differences between motion vectors of a second central block of the target block pointing to a current frame within a search range and the basic motion vector;
clustering the first set of motion vectors and the second set of motion vectors to obtain an additional motion vector of the target block;
obtaining a pixel value of the target block based on the basic motion vector and the additional motion vector;
wherein obtaining the first set of motion vectors comprises:
taking a block in the previous frame which basic motion vector of the target block points to as the first central block;
obtaining motion vectors of a plurality of first surrounding blocks of the first central block within the search range;
determining whether differences between the motion vectors of the plurality of the first surrounding blocks and the basic motion vector are greater than a first predetermined threshold;
in response to a determination that a difference between a motion vector of one of the plurality of the first surrounding blocks and the basic motion vector is greater than a first predetermined threshold, classifying the motion vector of the one of the plurality of the first surrounding blocks into the first set of motion vectors; and
obtaining the second set of motion vectors comprises:
defining a block in the current frame which basic motion vector of the target block points to as the second central block;
obtaining motion vectors of a plurality of second surrounding blocks of the second central block within the search range;
determining whether differences between the motion vectors of the plurality of the second surrounding blocks and the basic motion vector are greater than a first predetermined threshold; and
in response to a determination that a difference between a motion vector of one of the plurality of the second surrounding blocks and the basic motion vector is greater than a first predetermined threshold, classifying the motion vector of the one of the plurality of the second surrounding blocks into the second set of motion vectors.

2. The method of claim 1 , wherein the first predetermined threshold is within a range of one-third of the basic motion vector to two-thirds of the basic motion vector.

3. The method of claim 1 , wherein obtaining the pixel value of the target block based on the basic motion vector and the additional motion vector comprises:
obtaining the pixel value of the basic motion vector in the previous frame as a first basic pixel value and the pixel value of the basic motion vector in the current frame as a second basic pixel value;
obtaining the pixel values of the additional motion vector in the previous frame and the current frame as reference pixel values;
obtaining a pixel value of the target block based on a pixel value of the reference pixel values that has a correlation with the basic pixel value.

4. The method of claim 3 , wherein obtaining the pixel value of the target block based on the pixel value of the reference pixel values that has a correlation with the basic pixel value comprises:
for each reference pixel value,
calculating a first difference between the reference pixel value and the first basic pixel value, and a second difference between the reference pixel value and the second base pixel value;
calculating a sum of the first difference and second difference as a deviation amount;
determining whether the deviation amount corresponding to the reference pixel value is less than a second predetermined threshold; and
in response to the deviation amount being less than the second predetermined threshold, taking the reference pixel value as a target pixel value;
for each additional motion vector, taking a mean or a median value of the target pixel values as the pixel value of the target block.

5. The method of claim 4 , wherein the second predetermined threshold is within a range of one-fifth to one-half of the first basic pixel value, or, the second predetermined threshold is within a range of one-fifth to one-half of the second basic pixel value.

6. The method of claim 1 , wherein clustering the first set of motion vectors and the second set of motion vectors to obtain the additional motion vector of the target block comprises:
dividing the first set of motion vectors and the second set of motion vectors into a plurality of groups based on variabilities of the motion vectors;
taking a mean value of the motion vectors or a median value of the motion vectors in each group as the additional motion vector.

7. The method of claim 1 , wherein determining whether the current block is located at the junction of the foreground and the background comprises:
obtaining a motion vector of the current block;
determining whether motion vectors of surrounding blocks centered on the current block are the same as the motion vector of the current block;
in response to a determination that a motion vector of a surrounding block is different from the motion vector of the current block, determining that the current block is located at the junction of foreground and background.

8. A chip, comprising a motion compensation module, the motion compensation module comprising:
a judgment unit, configured to determine whether a current block is located at a junction of a foreground and a background;
an extraction unit, configured to mark the current block as a target block, a motion vector of the target block being a basic motion vector, in response to a determination that the current block is located at the junction of the foreground and the background;
a calculation unit, configured to:
(i) obtain a first set of motion vectors based on differences between motion vectors of a first central block of the target block pointing to a previous frame within a search range and the basic motion vector; and
(ii) obtain a second set of motion vectors based on differences between motion vectors of a second central block of the target block pointing to a current frame within a search range and the basic motion vector;

a clustering unit, configured to cluster the first set of motion vectors and the second set of motion vectors to obtain an additional motion vector of the target block; and
an interpolation unit, configured to obtain a pixel value of the target block based on the basic motion vector and the additional motion vector;
wherein the calculation unit further comprises:
a valuation cell, configured to take a block in the previous frame which basic motion vector of the target block points to as the first central block; and obtain motion vectors of a plurality of first surrounding blocks of the first central block within the search range; and configure to define a block in the current frame which basic motion vector of the target block points to as the second central block; and obtain motion vectors of a plurality of second surrounding blocks of the second central block within the search range;
a comparison cell, configured to determine whether differences between the motion vectors of the plurality of the second surrounding blocks and the basic motion vector are greater than a

Assignees

• Amlogic Shanghai Co Ltd

Inventors

• Ji Tao
• He Zhihong
• Wang Chun
• Wang Dongjian
• Chen Xuyun

Classifications

• H04N19/139

  Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability · CPC title

• H04N5/145

  Movement estimation (for video coding H04N19/51) · CPC title

• H04N5/21

  Circuitry for suppressing or minimising disturbance, e.g. moiré or halo · CPC title

• G06T7/223

  using block-matching · CPC title

• H04N19/533

  Motion estimation using multistep search, e.g. two-dimensional [2D]-log search or one-at-a-time search [OTS] · CPC title