Adaptive partition coding

Patent metadata

Field	Value
Publication number	US-11863763-B2
Application number	US-202117170289-A
Country	US
Kind code	B2
Filing date	Feb 8, 2021
Priority date	Nov 11, 2011
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.

First claim

What is claimed:

1. A decoder for reconstructing a block of a depth map associated with a texture picture from a data stream, configured to:
determine a texture threshold based on sample values of a reference block of a texture picture,
determine a partitioning of the reference block of the text picture based on the texture threshold;
transfer the partitioning of the reference block of the text picture onto a block of a depth map to obtain a contour partition of the block of the depth map such that the block of the depth map is segmented into two portions; and
reconstruct the block of the depth map by decoding the two portions associated with the contour partition of the block of the depth map.

2. The decoder according to claim 1 , further configured to:
determine the partitioning of the reference block of the texture picture based on a comparison of one or more sample values of the reference block with the texture threshold; and
use a coding option identifier from the data stream as an index to perform the determining of the texture threshold, the determining of the partitioning of the reference block, and the transferring the partitioning.

3. The decoder according to claim 2 , configured to, in determining the partitioning of the reference block, individually check values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of first and second portions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each other.

4. The decoder according to claim 3 , configured to, in determining the partitioning of the reference block, individually check values of the texture picture within the reference block at sample resolution so that each tile corresponds to a sample position of the reference block.

5. The decoder according to claim 2 , configured to, in determining the partitioning of the reference block, apply morphological hole filling and/or low-pass filtering onto a result of the comparing in order to acquire two portions of the reference block.

6. The decoder according to claim 2 , configured to, in determining the texture threshold, determine a measure for a central tendency of reconstructed sample values of the reference block of the texture picture, wherein the measure represents the texture threshold.

7. The decoder according to claim 2 , wherein the partitioning of the reference block is determined by comparing each sample of the reference block with the texture threshold.

8. An encoder for encoding a block of a depth map associated with a texture picture into a data stream, configured to:
determine a texture threshold based on sample values of a reference block of a texture picture,
determine a partitioning of the reference block of the text picture based on the texture threshold;
transfer the partitioning of the reference block of the text picture onto a block of a depth map to obtain a contour partition of the block of the depth map such that the block of the depth map is segmented into two portions; and
encode, into the data stream, the block of the depth map based on the two portions associated with the contour partition of the block of the depth map.

9. The encoder according to claim 8 , further configured to:
determine the partitioning of the reference block of the texture picture based on a comparison of one or more sample values of the reference block with the texture threshold; and
use a coding option identifier from the data stream as an index to perform the determining of the texture threshold, the determining of the partitioning of the reference block, and the transferring the partitioning.

10. The encoder according to claim 9 , configured to, in determining the partitioning of the reference block, individually check values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of first and second portions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each other.

11. The encoder according to claim 10 , configured to, in determining the partitioning of the reference block, individually check values of the texture picture within the reference block at sample resolution so that each tile corresponds to a sample position of the reference block.

12. The encoder according to claim 9 , configured to, in determining the partitioning of the reference block, apply morphological hole filling and/or low-pass filtering onto a result of the comparing in order to acquire two portions of the reference block.

13. The encoder according to claim 9 , configured to, in determining the texture threshold, determine a measure for a central tendency of reconstructed sample values of the reference block of the texture picture, wherein the measure represents the texture threshold.

14. The encoder according to claim 9 , wherein the partitioning of the reference block is determined by comparing each sample of the reference block with the texture threshold.

15. A non-transitory computer-readable medium for storing data associated with a video, comprising:
a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information of a reference block of a texture picture of the video and encoded information of a block in a depth map of the video, wherein the block in the depth map corresponds to the reference block of the texture picture, wherein the block in the depth map is decoded using a plurality of operations including:
determining a texture threshold based on sample values of a reference block of a texture picture,
determining a partitioning of the reference block of the text picture based on the texture threshold;
transferring the partitioning of the reference block of the text picture onto a block of a depth map to obtain a contour partition of the block of the depth map such that the block of the depth map is segmented into two portions; and
reconstructing the block of the depth map by decoding the two portions associated with the contour partition of the block in the depth map.

16. The computer-readable medium according to claim 15 , wherein the plurality of operations further comprises:
determining the partitioning of the reference block of the texture picture based on a comparison of one or more sample values of the reference block with the texture threshold; and
using a coding option identifier from the data stream as an index to perform the determining of the texture threshold, the determining of the partitioning of the reference block, and the transferring the partitioning.

17. The computer-readable medium according to claim 16 , wherein determining the partitioning of the reference block includes individually checking values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of first and second portions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each

Assignees

• Ge Video Compression Llc

Inventors

• Merkle Philipp
• Bartnik Christian
• Lakshman Haricharan
• Marpe Detlev
• Mueller Karsten
• Wiegand Thomas
• Tech Gerhard

Classifications

• H04N19/117

  Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) · CPC title

• H04N19/176 Primary

  the region being a block, e.g. a macroblock · CPC title

• H04N19/103

  Selection of coding mode or of prediction mode · CPC title

• H04N19/105

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/119 Primary

  Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks · CPC title