Method and apparatus of texture image compress in 3D video coding

Patent metadata

Field	Value
Publication number	US-9918068-B2
Application number	US-201214115099-A
Country	US
Kind code	B2
Filing date	Jun 15, 2012
Priority date	Jun 15, 2011
Publication date	Mar 13, 2018
Grant date	Mar 13, 2018

Abstract

A method and apparatus for texture image compression in a 3D video coding system are disclosed. Embodiments according to the present invention derive depth information related to a depth map associated with a texture image and then process the texture image based on the depth information derived. The invention can be applied to the encoder side as well as the decoder side. The encoding order or decoding order for the depth maps and the texture images can be based on block-wise interleaving or picture-wise interleaving. One aspect of the present invent is related to partitioning of the texture image based on depth information of the depth map. Another aspect of the present invention is related to motion vector or motion vector predictor processing based on the depth information.

First claim

The invention claimed is:

1. A method for texture image compression in a three-dimensional (3D) video coding system, the method comprising:
encoding or decoding a depth map;
deriving depth information related to the depth map; and
encoding or decoding a texture image based on the depth information derived, wherein a processing order relating to an encoding order or a decoding order for the depth map and the texture image is based picture-wise interleaving, wherein the texture image is partitioned into texture blocks, wherein motion information of a texture block of the texture image is derived from motion information of a corresponding texture block in another view or a corresponding depth block of the depth map, and wherein a location of the corresponding texture block is derived based on the depth map,
wherein information for the processing order is indicated in a bitstream associated with the texture image,
wherein said encoding or decoding the texture image comprises determining a mode for a current region of the texture image based on a mode of a corresponding region of a corresponding texture image in another view.

2. The method of claim 1 , wherein the depth information comprises depth data and partition information.

3. The method of claim 1 , wherein, for decoder side, the depth map is decoded from a first bitstream comprising a first compressed depth map for a current view, decoded and derived from a second bitstream comprising a second compressed depth map for other view, or derived from a decoded texture image.

4. The method of claim 1 , wherein the block-wise interleaving or the picture-wise interleaving is selected according to a flag in the bitstream associated with the texture image.

5. The method of claim 4 , wherein the flag is incorporated in a sequence level, a picture level, a slice level, or a block level.

6. The method of claim 1 , wherein partitioning a current texture block of the texture image is based on the depth information of the depth map.

7. The method of claim 6 , wherein the texture blocks are in arbitrary shapes or rectangular shapes.

8. The method of claim 6 , wherein whether to partition the current texture block of the texture image into sub-blocks is based on the depth information of a corresponding current block of the depth map.

9. The method of claim 8 , wherein shapes of the sub-blocks are based on the depth information of the corresponding current block of the depth map.

10. The method of claim 8 , wherein a flag is used to indicate whether the depth information of the corresponding current block of the depth map is used for partitioning the current texture block of the texture image into the sub-blocks.

11. The method of claim 1 , wherein the texture image is partitioned into texture blocks and wherein whether to merge a current texture block of the texture image with another texture block of the texture image is based on the depth information of the depth map.

12. The method of claim 11 , wherein a flag is used to indicate whether Merge mode is enabled.

13. The method of claim 1 , wherein the motion information comprises MVs, reference picture index, region partitions, prediction direction, and prediction mode.

14. The method of claim 1 , wherein said encoding or decoding the texture image comprises determining prediction modes for the texture image according to motion vectors associated with the texture image, and wherein the motion vectors are classified based on the depth information.

15. The method of claim 14 , wherein first regions corresponding to near objects in the texture image as indicated by the depth information prefer to select spatial MVPs (Motion Vector Predictors), and wherein second regions corresponding to far objects in the texture image as indicated by the depth information prefer to select temporal or inter-view MVPs.

16. The method of claim 1 , wherein said encoding or decoding the texture image comprises pruning MVPs (Motion Vector Predictors) for the texture image according to motion vectors associated with the texture image, and wherein the motion vectors are classified based on the depth information.

17. The method of claim 16 , wherein one or more redundant candidate MVPs are removed from MVP candidate list, and wherein the candidate MVPs with large motions for regions corresponding to far objects in the texture image as indicated by the depth information are removed or given low priorities in the MVP candidate list.

18. The method of claim 1 , wherein said encoding or decoding the texture image comprises determining motion models for deriving motion vectors for the texture image, and wherein said determining motion models depends on the depth map.

19. The method of claim 18 , wherein first regions corresponding to far objects in the texture image derive the motion vectors according to a translation model, and wherein second regions corresponding to near objects in the texture image derive the motion vectors according to a perspective model.

20. The method of claim 1 , wherein location of the corresponding texture block is derived based on the depth map in a current view, wherein location of the corresponding region is derived from location of the current region and location correspondence between the depth map associated with the texture image and the depth map associated with the corresponding texture image in said another view.

21. The method of claim 1 , wherein the mode comprises prediction type, block size, reference picture index, prediction direction, and partition.

22. An apparatus for texture image compression in a 3D video coding system, the apparatus comprising at least one circuit configured for:
encoding or decoding a depth map;
deriving depth information related to the depth map; and
encoding or decoding a texture image based on the depth information derived, wherein a processing order relating to an encoding order or a decoding order for the depth map and the texture image is based on picture-wise interleaving, wherein the texture image is partitioned into texture blocks, wherein motion information of a texture block of the texture image is derived from motion information of a corresponding texture block in another view or a corresponding depth block of the depth map, and wherein a location of the corresponding texture block is derived based on the depth map,
wherein information for the processing order is indicated in a bitstream associated with the texture image,
wherein said encoding or decoding the texture image comprises determining a mode for a current region of the texture image based on a mode of a corresponding region of a corresponding texture image in another view.

23. The apparatus of claim 22 , wherein the depth information comprises depth data and partition information.

24. The apparatus of claim 22 , wherein, for decoder side, the depth map is decoded from a first bitstream comprising first compressed depth map for a current view, decoded and derived from a second bitstream comprising second compressed depth map for other view, or derived from a decoded texture image.

25. The apparatus of claim 22 , wherein partitioning a current texture block of the texture image is based on the depth information of the depth map.

26. The apparatus of claim 22 , wherein the texture image is partitioned into texture blocks and wherein whether to merge a current texture block of the texture image with another textu

Assignees

• Chang Yu Lin
• Hsiang Shih Ta
• Wu Chi Ling
• Fu Chih Ming
• Chen Chia Ping
• Tsai Yu Pao
• Huang Yu Wen
• Lei Shaw Min
• Media Tek Inc

Inventors

• Chang Yu-Lin
• Hsiang Shih-Ta
• Wu Chi-Ling
• Fu Chih-Ming
• Chen Chia-Ping
• Tsai Yu-Pao
• Huang Yu-Wen
• Lei Shaw-Min

Classifications

• G06T9/00

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title

• H04N19/119

  Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks · CPC title

• H04N13/0048 Primary

  Electricity · mapped topic

• H04N19/503

  involving temporal prediction (adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109) · CPC title

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title