Devices and methods for video coding using segmentation based partitioning of video coding blocks

Patent metadata

Field	Value
Publication number	US-10931965-B2
Application number	US-201816227317-A
Country	US
Kind code	B2
Filing date	Dec 20, 2018
Priority date	Jun 24, 2016
Publication date	Feb 23, 2021
Grant date	Feb 23, 2021

Abstract

The invention relates to an encoding apparatus for processing a video signal comprising a plurality of frames dividable into video coding blocks. A first video coding block of a current frame of the video signal is partitioned into a first segment associated with a first segment motion vector relative to a first reference frame of the video signal and a second segment. The first video coding block is associated with a plurality of virtual partitions. Each virtual partition is associated with a respective subset of the plurality of video coding blocks of the current frame. Each video coding block of the respective subset neighbors the first video coding block and is associated with a motion vector.

First claim

What is claimed is:

1. An apparatus for encoding a video signal, the video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, the apparatus comprising:
a partitioner configured to partition a first video coding block of the plurality of video coding blocks of a current frame of the video signal into a first segment and a second segment, wherein the first segment is associated with a first segment motion vector relative to a first reference frame of the video signal, and wherein the first and second segment have an irregular shape, wherein the first video coding block is associated with a plurality of predefined virtual partitions of the first video coding block, and each predefined virtual partition is associated with a respective subset of the plurality of video coding blocks of the current frame of the video signal, wherein each video coding block of the respective subset neighbors the first video coding block and is associated with a motion vector;
an encoding processor configured to encode, for each of the virtual partitions, the first segment motion vector on the basis of at least one motion vector of the neighboring video coding blocks associated with a selected virtual partition for encoding the first video coding block; and
a selector configured to select the virtual partition of the first video coding block on the basis of a respective performance measure associated with the encoding of the first segment motion vector, and to generate a virtual partition identifier identifying the virtual partition selected by the selector and coding information including the encoded first segment motion vector.

2. The apparatus of claim 1 , wherein the selector is configured to select the virtual partition of the first video coding block on the basis of a respective rate distortion measure associated with the encoding of the first segment motion vector.

3. The apparatus of claim 1 , wherein the encoding processor is configured to encode the first segment motion vector on the basis of at least one motion vector of the neighboring video coding blocks associated with the selected virtual partition of the first video coding block and at least one motion vector of a co-located video coding block in a neighboring frame of the video signal.

4. The apparatus of claim 1 , wherein the encoding processor is configured to encode the virtual partition identifier along with the first video coding block.

5. The apparatus of claim 1 , wherein a boundary motion vector is associated with a boundary between the first segment and the second segment of the first video coding block and wherein the encoding processor is configured to encode the boundary motion vector on the basis of at least one of the first segment motion vector and a second segment motion vector associated with the second segment.

6. The apparatus of claim 5 , wherein the encoding processor is configured to encode the boundary motion vector by rescaling a first segment motion vector of the co-located video coding block in a reference frame.

7. The apparatus of claim 1 , wherein the encoding processor is configured to encode the first segment motion vector on the basis of at least one motion vector of the neighboring video coding blocks associated with the selected virtual partition of the first video coding block using motion vector merging.

8. The apparatus of claim 1 , wherein the set of virtual partitions of the first video coding block comprises the partitions 2N×N, N×2N, 2N×nU, 2N×nD, nL×2N and nR×2N of the first video coding block.

9. A method for encoding a video signal, the video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, the method comprising:
partitioning a first video coding block of the plurality of video coding blocks of a current frame of the video signal into a first segment and a second segment, wherein the first segment is associated with a first segment motion vector relative to a reference frame of the video signal, and wherein the first and second segment have an irregular shape and wherein the first video coding block is associated with a plurality of predefined virtual partitions of the first video coding block, and each predefined virtual partition is associated with a respective subset of the plurality of video coding blocks of the current frame of the video signal, wherein each video coding block of the respective subset neighbors the first video coding block and is associated with a motion vector;
encoding, for each of the virtual partitions, the first segment motion vector on the basis of at least one motion vector of the neighboring video coding blocks associated with a selected virtual partition of the first video coding block; and
selecting the virtual partition of the first video coding block on the basis of a respective performance measure associated with the encoding of the first segment motion vector and generating a virtual partition identifier identifying the selected virtual partition and coding information including the encoded first segment motion vector.

10. An apparatus for decoding an encoded video signal, the encoded video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, the apparatus comprising:
a decoding processor configured to:
receive coding information and a virtual partition identifier for decoding a first video coding block in a current frame,
select a virtual partition of the first video coding block based on the decoded virtual partition identifier, wherein the virtual partition is associated with a subset of the plurality of video coding blocks of the current frame of the encoded video signal, and wherein each video coding block of the subset neighbors the first video coding block; and
decode the first segment motion vector on the basis of at least one motion vector of the neighboring video coding blocks associated with a identified virtual partition of the first video coding block; and
a partitioner configured to partition a co-located first video coding block in a first reference frame of the encoded video signal into a first segment and a second segment, wherein the first and second segment have an irregular shape, and
wherein the decoding apparatus is further configured to perform motion compensation for the first segment based on the decoded first segment motion vector.

11. The apparatus of claim 10 , wherein the decoding processor is configured to decode the first segment motion vector on the basis of at least one motion vector of the neighboring video coding blocks associated with the virtual partition of the first video coding block and at least one motion vector of a video coding block in a neighboring frame of the encoded video signal.

12. The apparatus of claim 10 , wherein the decoding processor is configured to decode the first segment motion vector on the basis of at least one motion vector of the neighboring video coding blocks associated with the virtual partition of the first video coding block using motion vector merging.

13. The apparatus of claim 10 , wherein the virtual partition of the first video coding block is one of the following partitions: a 2N×N, N×2N, 2N×nU, 2N×nD, nL×2N or nR×2N partition of the first video coding block.

14. The apparatus of claim 10 , wherein the decoding processor is configured to decode a boundary motion vector associated with a boundary between the first segment and the second segment on the basis of the first segment motion vector and wherein the partitioner is configured to partition the co-located first video coding

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhao Zhijie
• Blaeser Max
• Wien Mathias

Classifications

• H04N19/176 Primary

  the region being a block, e.g. a macroblock · CPC title

• H04N19/91

  Entropy coding, e.g. variable length coding [VLC] or arithmetic coding · CPC title

• H04N19/521

  for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors · CPC title

• H04N19/119

  Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks · CPC title

• H04N19/147

  according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567) · CPC title