Devices and methods for video coding using segmentation based partitioning of video coding blocks

Patent metadata

Field	Value
Publication number	US-10924756-B2
Application number	US-201816227249-A
Country	US
Kind code	B2
Filing date	Dec 20, 2018
Priority date	Jun 24, 2016
Publication date	Feb 16, 2021
Grant date	Feb 16, 2021

Abstract

Embodiments of the disclosure relate to an encoding apparatus and a decoding apparatus. The encoding apparatus is configured to process a video signal, the video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, each video coding block comprising a plurality of pixels. The encoding apparatus comprises a partitioner configured to partition a first video coding block of the plurality of video coding blocks of a first frame of the video signal into a first segment and a second segment, wherein the first segment comprises a first set of the plurality of pixels of the first video coding block and the second segment comprises a second set of the plurality of pixels of the first video coding block.

First claim

What is claimed is:

1. An encoding apparatus for processing a video signal, the video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, each video coding block comprising a plurality of pixels, the encoding apparatus comprising:
a partitioner configured to partition a first video coding block of the plurality of video coding blocks of a first frame of the video signal into a first segment and a second segment, wherein the first segment comprises a first set of the plurality of pixels of the first video coding block and the second segment comprises a second set of the plurality of pixels of the first video coding block;
a determiner configured to determine a position of the first segment in a co-located block in a second frame of the video signal on the basis of at least some of the plurality of pixels of the first video coding block and at least one extension region in the second frame of the video signal, wherein the extension region neighbors the co-located block in the second frame; and
an encoding processor configured to code coding information of the first video coding block and side information of the extension region on the basis of the position of the first segment in the second frame of the video signal, the coding information including at least one of prediction error and motion information,
wherein the extension region is a subset of one or more video coding blocks neighboring the co-located coding block in the second frame, and
wherein the determiner is configured to adjust an extension region width of the extension region based on a size of the first video coding block.

2. The encoding apparatus of claim 1 , wherein the determiner is configured to increase the extension region width in case the number of pixels of the first video coding block decreases.

3. The encoding apparatus of claim 2 , wherein the determiner is configured to adjust the extension region width to 16 pixels in case the first video coding block comprises 32×32 pixels or to adjust the extension region width to 8 pixels in case the first video coding block comprises 64×64 pixels.

4. The encoding apparatus of claim 2 , wherein the determiner is configured to adjust the extension region width to 16 pixels in case the first video coding block comprises 8×8 pixels or to adjust the extension region width to 8 pixels in case the first video coding block comprises 16×16 pixels.

5. The encoding apparatus of claim 1 , wherein the determiner is configured to determine a position of the first segment in the second frame of the video signal on the basis of at least some of the plurality of pixels of the first video coding block sampled using a first sampling density and at least some of a plurality of pixels of the extension region using a second sampling density, wherein the first sampling density and/or the second sampling density depends on the size of the first video coding block.

6. The encoding apparatus of claim 5 , wherein the determiner is configured to increase the first sampling density in case the number of pixels of the first video coding block decreases.

7. The encoding apparatus of claim 5 , wherein the first sampling density is larger than the second sampling density.

8. The encoding apparatus of claim 1 , wherein the side information includes at least one of a shape of the extension region, a size of the extension region and a sampling pattern, said side information being received on one of a coding block level, slice level, picture level and sequence level.

9. A decoding apparatus for processing a video signal, the video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, each video coding block comprising a plurality of pixels, the decoding apparatus comprising:
a decoding processor configured to decode coding information of a first video coding block of the plurality of video coding blocks in a current frame and side information of an extension region of a co-located block in a reference frame of the video signal, the extension region neighboring the co-located block in the reference frame;
a partitioner configured to partition the co-located video coding block in the reference frame into a first segment and a second segment based on the decoded coding information and side information, wherein the first segment comprises a first set of the plurality of pixels of the co-located video coding block and the second segment comprises a second set of the plurality of pixels of the co-located video coding block; and
a reconstruction unit configured to reconstruct the first video coding block based on the decoded coding information, the first segment and second segment in the reference frame,
wherein the extension region is a subset of one or more video coding blocks neighboring the co-located coding block in the second frame, and
wherein the side information includes:
a size of the extension region including an extension region width, where the extension region width is adjusted based on a size of the first video coding block; and
at least one of a shape of the extension region and a sampling pattern, and

wherein the side information being received on one of a coding block level, a slice level, a picture level and a sequence level.

10. The decoding apparatus of claim 9 , wherein the side information is context based adaptive binary arithmetic coded, the context being defined by side information of at least one neighboring block.

11. A method for processing a video signal, the video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, each video coding block comprising a plurality of pixels, the method comprising:
partitioning a first video coding block of the plurality of video coding blocks of a first frame of the video signal into a first segment and a second segment, wherein the first segment comprises a first set of the plurality of pixels of the first video coding block and the second segment comprises a second set of the plurality of pixels of the first video coding block;
determining a position of the first segment in a co-located block in a second frame of the video signal on the basis of at least some of the plurality of pixels of the first video coding block and at least one extension region in the second frame of the video signal, wherein the extension region neighbors the co-located block in the second frame;
adjusting an extension region width of the extension region based on a size of the first video coding block, wherein the extension region is a subset of one or more video coding blocks neighboring the co-located coding block in the second frame; and
coding coding information of the first video coding block and side information of the extension region on the basis of the position of the first segment in the second frame of the video signal, the coding information including at least one of prediction error and motion information.

12. A method for processing a video signal, the video signal comprising a plurality of frames, each frame being dividable into a plurality of video coding blocks, each video coding block comprising a plurality of pixels, the method comprising:
decoding coding information of a first video coding block of the plurality of video coding blocks in a current frame and side information of an extension region of a co-located block in a reference frame of the video signal, the extension region neighboring the co-located block in the reference frame;
partitioning the co-located video coding block in the reference frame into a first segment and a second segment based on the decoded coding info

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhao Zhijie
• Blaeser Max
• Wien Mathias

Classifications

• H04N19/13

  Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC] · CPC title

• H04N19/117

  Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) · CPC title

• H04N19/119

  Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks · CPC title

• H04N19/567

  Motion estimation based on rate distortion criteria · CPC title

• H04N19/105

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title