Motion estimation method, chip, electronic device, and storage medium

Patent metadata

Field	Value
Publication number	US-11574408-B2
Application number	US-202117304961-A
Country	US
Kind code	B2
Filing date	Jun 29, 2021
Priority date	Jun 30, 2020
Publication date	Feb 7, 2023
Grant date	Feb 7, 2023

Abstract

The present disclosure relates to a motion estimation method, a chip, an electronic device, and a storage medium. The present disclosure is beneficial to improving the accuracy of motion estimation.

First claim

What is claimed is:

1. A motion estimation method, comprising:
providing an original frame, the original frame comprising an adjacent previous frame and a current frame;
obtaining a matching block in the previous frame corresponding to a current block of the current frame using a full search method;
obtaining a matching block in the current frame corresponding to the current block of the previous frame utilizing a full search method;
obtaining a first candidate vector set corresponding to a corresponding block of the current frame based on the current block of the current frame and the corresponding matching block;
obtaining a second candidate vector set corresponding to a corresponding block of the previous frame based on the current block of the previous frame and the corresponding matching block;
setting a frame to be interpolated between the previous frame and the current frame; and
obtaining a bidirectional motion vector corresponding to the current block of the frame to be interpolated based on the first candidate vector set and the second candidate vector set, as a candidate motion vector of the corresponding block of the frame to be interpolated.

2. The motion estimation method of claim 1 , wherein obtaining the matching block comprises: obtaining the matching block corresponding to the current block based on a match error and a distance between the match error and the current block by using a full search method.

3. The motion estimation method of claim 2 , wherein obtaining a matching block in a current frame corresponding to a current block of a previous frame comprises: obtaining a plurality of candidate blocks in the current frame utilizing a full search method, wherein the match error between the candidate blocks and the current block of previous frame is in a preset threshold range; and taking one candidate block with the smallest distance from the current block of the previous frame as the matching block,
obtaining a matching block in a current frame corresponding to a current block of a previous frame comprises: obtaining a plurality of candidate blocks in the previous frame utilizing a full search method, wherein the match error between the candidate blocks and the current block in the current frame is in a preset threshold range; and taking one candidate block with the smallest distance from the current block of the previous frame as the matching block.

4. The motion estimation method of claim 1 , wherein the search step size of the full search method is greater than or equal to one pixel, and the search step size of the full search method is smaller than the side length of the block.

5. The motion estimation method of claim 1 , wherein obtaining the first candidate vector set and the second candidate vector set comprises:
obtaining a backward motion vector of the corresponding block of the current frame based on the current block of the current frame and the corresponding matching block;
forming the first candidate vector set based on the backward motion vector corresponding to the plurality of blocks of the current frame;
obtaining a forward motion vector of the corresponding block of the previous frame based on the current block of the previous frame and the corresponding matching block; and
forming the second candidate vector set based on the forward motion vector corresponding to the plurality of blocks of the previous frame.

6. The motion estimation method of claim 1 , wherein obtaining a bidirectional motion vector corresponding to a current block of a frame to be interpolated based on the first candidate vector set and the second candidate vector set comprises:
based on the current block of the frame to be interpolated as a reference, obtaining a backward motion vector corresponding to all blocks within a preset search range of a corresponding position in the current frame based on the first candidate vector set as a first motion vector;
based on the current block of the frame to be interpolated as a reference, obtaining a forward motion vector corresponding to all blocks within a preset search range of a corresponding position in the previous frame based on the second candidate vector set as a second motion vector; and
obtaining a first motion vector and a second motion vector which both pass through the current block and are in the same direction as the bidirectional motion vector.

7. The motion estimation method of claim 6 , wherein in response to the bidirectional motion vector being multiple pairs, obtaining the candidate motion vector of the corresponding block of the frame to be interpolated further comprises:
comparing the match error of corresponding blocks of the bidirectional motion vector in the previous frame and the current frame; and
obtaining the bidirectional motion vector corresponding to the minimum match error as the candidate motion vector of the corresponding block of the frame to be interpolated.

8. The motion estimation method of claim 1 , wherein the motion estimation method further comprises:
before a full search method is utilized to obtain a matching block in the previous frame corresponding to the current block of the current frame, and before obtaining a matching block in the current frame corresponding to the current block of the previous frame using a full search method, identifying a block corresponding to a foreground moving small object in the previous frame and the current frame; and
obtaining the corresponding matching block in the previous frame for the block of the moving small object in the current frame utilizing a full search method; and
obtaining a matching block corresponding to the block of the previous frame small object in the current frame utilizing a full search method.

9. The motion estimation method of claim 8 , further comprising utilizing image segmentation method to identify the block corresponding to the foreground moving small object in the previous frame and the current frame.

10. A chip, wherein the chip comprises a motion estimation module, the motion estimation module comprises:
a providing unit, which is used for providing an original frame, he original frame comprising an adjacent previous frame and a current frame;
a search unit, which is used for obtaining a matching block in the previous frame corresponding to a current block of the current frame using a full search method, and obtaining a matching block in the current frame corresponding to the current block of the previous frame utilizing a full search method;
a computing unit, which is used for obtaining a first candidate vector set corresponding to a corresponding block of the current frame based on the current block of the current frame and the corresponding matching block, and obtaining a second candidate vector set corresponding to a corresponding block of the previous frame based on the current block of the previous frame and the corresponding matching block;
a setting unit, which is used for setting a frame to be interpolated between the previous frame and the current frame; and
an acquisition unit, which is used for obtaining a bidirectional motion vector corresponding to the current block of the frame to be interpolated based on the first candidate vector set and the second candidate vector set output by the computing unit, and outputting the bidirectional motion vector as a candidate motion vector of the corresponding block of the frame to be interpolated.

11. The chip of claim 10 , wherein the computing unit comprises: a first sub-computing unit, which is used for obtaining a backward motion vector of the corresponding block of the current frame based on the current block of the current frame and the corresponding matchin

Assignees

• Amlogic Shanghai Co Ltd

Inventors

• Bao Zheng
• Ji Tao
• Wang Chun
• Wang Dongjian
• Chen Xuyun

Classifications

• G06T3/4007 Primary

  based on interpolation, e.g. bilinear interpolation (image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403) · CPC title

• G06T7/215

  Motion-based segmentation · CPC title

• H04N7/0127

  by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter · CPC title

• G06T7/231 Primary

  using full search · CPC title

• G06T7/223

  using block-matching · CPC title