Region-of-interest based 3D video coding

Patent metadata

Field	Value
Publication number	US-10075689-B2
Application number	US-201213977368-A
Country	US
Kind code	B2
Filing date	Jul 4, 2012
Priority date	Jul 4, 2012
Publication date	Sep 11, 2018
Grant date	Sep 11, 2018

Abstract

Systems, apparatus, articles, and methods are described including operations for region-of-interest based 3D video coding.

First claim

What is claimed:

1. A computer-implemented method for video coding, comprising:
extracting a region-of-interest pattern for a video picture, wherein the region-of-interest pattern is extracted based at least in part on a received depth map associated with the video picture and one or more received camera parameters, wherein the extraction of the region-of-interest pattern further comprises:
determining a camera focal point based at least in part on the camera parameters,
determining a focal region unit based at least in part on the camera focal point,
determining a characteristic focal depth value of the a focal region unit based at least in part on the depth map,
determining a region unit depth value for individual region units, and
designating any region unit as being a region-of-interest or a region-of-non-interest of the region-of-interest pattern based at least in part on a comparison of the determined region unit depth values to the characteristic focal depth value, wherein the comparison includes comparing a difference between the determined region unit depth values and the characteristic focal depth value associated with the camera focal point to a threshold value;

partitioning the video picture based at least in part on the extracted region-of-interest pattern, wherein the partitioned video picture comprises one or more regions-of-interest and one or more regions-of-non-interest; and
coding the one or more regions-of-interest and the one or more regions-of-non-interest.

2. The method of claim 1 , wherein the coding of the prediction unit comprises 3D decoding.

3. The method of claim 1 , wherein the partitioning of the video picture, during encoding, comprises splitting the video picture into one or more regions-of-interest picture portions and one or more regions-of-non-interest picture portions.

4. The method of claim 1 , wherein the partitioning of the video picture, during encoding, comprises assembling the video picture from one or more regions-of-interest picture portions and one or more regions-of-non-interest picture portions.

5. The method of claim 1 , wherein the extraction of the region-of-interest pattern further comprises:
determining a checking window associated with a portion of the video picture based at least in part on the camera focal point, and
designating any region unit located outside the checking window as being a region-of-non-interest of the region-of-interest pattern.

6. The method of claim 1 , wherein the extraction of the region-of-interest pattern further comprises:
further designating region-of-interest region units of the region-of-interest pattern as belonging to two or more index types based at least in part on the comparison of the determined region unit depth values to the characteristic focal depth value.

7. The method of claim 1 , wherein the extraction of the region-of-interest pattern further comprises:
determining a checking window associated with a portion of the video picture based at least in part on the camera focal point,
designating any region unit located outside the checking window as being a region-of-non-interest of the region-of-interest pattern,
determining the region unit depth value for individual region units located within the checking window,
designating any region unit located within the checking window as being a region-of-interest or a region-of-non-interest of the region-of-interest pattern based at least in part on the comparison of the determined region unit depth values to the characteristic focal depth value, and
further designating region-of-interest region units of the region-of-interest pattern as belonging to two or more index types based at least in part on the comparison of the determined region unit depth values to the characteristic focal depth value.

8. The method of claim 1 , wherein, during coding, the one or more regions-of-non-interest picture portions are coded via a first standard different from a second standard applied to the one or more regions-of-interest picture portions.

9. The method of claim 1 , wherein, during coding, the one or more regions-of-non-interest picture portions are coded via a first standard different from a second standard applied to the one or more regions-of-interest picture portions, and wherein the second standard comprises a first sub-standard applied to a first index type of the one or more regions-of-interest picture portions and a second sub-standard applied to a second index type of the one or more regions-of-interest picture portions; and
wherein the first standard, the second standard, the first sub-standard and/or the second sub-standard differ based at least in part on one or more of the following criteria: different coding tools, different constraints, and different coding strategies; wherein the different coding tools differ based at least in part on one or more of the following criteria: application of lossless verses lossy coding to different regions and application of integer motion compensation verses fractional motion compensation to different regions; wherein the different constraints differ based at least in part on one or more of the following criteria: application of different reference picture number limitations to different regions and application of different prediction and transform sizes to different regions; and wherein the different coding strategies differ based at least in part on one or more of the following criteria: application of different search ranges for motion estimation to different regions and application of different quantization parameters to different regions.

10. The method of claim 1 , further comprising:
differentiating between a first type of region unit and a second type of region unit different from the first type, wherein the first and second type of region unit differ base on one or more of the following criteria: a slice-level criterion, a picture level criterion, and a view level criterion; and
selectively partitioning of the video picture based at least in part on the type of region unit.

11. The method of claim 1 , further comprising:
differentiating between a first type of region unit and a second type of region unit different from the first type, wherein the first and second type of region unit differ base on one or more of the following criteria: a slice-level criterion, a picture level criterion, and a view level criterion; and
selectively partitioning of the video picture based at least in part on the type of region unit based at least in part on one or more of the following criteria: application of partitioning verses no application of partitioning, application of different region unit sizes, application of different checking window sizes, and application of different thresholds associated with the comparison of the determined region unit depth values to the characteristic focal depth value.

12. The method of claim 1 , further comprising:
wherein the extraction of the region-of-interest pattern further comprises:
determining a checking window associated with a portion of the video picture based at least in part on the camera focal point,
designating any region unit located outside the checking window as being a region-of-non-interest of the region-of-interest pattern,
determining the region unit depth value for individual region units located within the checking window,
designating any region unit located within the checking window as being a region-of-interest or a region-of-non-interest of the region-of-interest pattern based at least in part on the comparison of the determined region unit depth values to the characteristic focal depth value, and
further designating region-o

Assignees

• Zhang Wenhao
• Chiu Yi Jen
• Xu Lidong
• Han Yu
• Deng Zhipin
• Cai Xiaoxia
• Intel Corp

Inventors

• Zhang Wenhao
• Chiu Yi-Jen
• Xu Lidong
• Han Yu
• Deng Zhipin
• Cai Xiaoxia

Classifications

• H04N13/161 Primary

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N2213/003

  Aspects relating to the "2D+depth" image format · CPC title

• H04N19/597

  specially adapted for multi-view video sequence encoding · CPC title

• H04N13/271

  wherein the generated image signals comprise depth maps or disparity maps · CPC title