3D video coding including depth based disparity vector calibration

Patent metadata

Field	Value
Publication number	US-9729849-B2
Application number	US-201213977331-A
Country	US
Kind code	B2
Filing date	Apr 19, 2012
Priority date	Apr 19, 2012
Publication date	Aug 8, 2017
Grant date	Aug 8, 2017

Abstract

Systems, apparatus, articles, and methods are described including operations for 3D video coding including depth based disparity vector calibration.

First claim

What is claimed:

1. A three dimensional (3D) video decoder apparatus comprising:
circuitry to partition a block of a first picture into two or more sub blocks of the block including a first sub block and a second sub block;
circuitry to access a depth map associated with the block;
circuitry to access a disparity vector associated with the block, wherein the disparity vector provides disparity compensated prediction by referencing an already decoded second picture having a different view with respect to the first picture;
circuitry to selectively determine a calibrated disparity vector for the first sub block based at least in part on the disparity vector associated with the block and the depth map, wherein to selectively determine the calibrated disparity vector, the circuitry determines, using the depth map, a characteristic depth value corresponding to the first sub block, and calibrates the disparity vector associated with the block based on the characteristic depth value to generate the calibrated disparity vector for the first sub block, wherein to calibrate the disparity vector to generate the calibrated disparity vector, the circuitry provides the calibrated disparity vector for the first sub block as a modification of the disparity vector associated with the block based at least in part on a scaling factor and an offset factor, wherein the scaling factor and the offset factor are determined based on the characteristic depth value; and
circuitry to perform disparity compensated inter-prediction for the first sub block based on the calibrated disparity vector associated with the first sub block.

2. The apparatus of claim 1 , wherein the characteristic depth value is an average depth value of multiple depth values corresponding to the first sub block.

3. The apparatus of claim 1 , wherein the characteristic depth value is a median depth value of multiple depth values corresponding to the first sub block.

4. The apparatus of claim 1 , wherein the circuitry to selectively determine the calibrated disparity vector for the first sub block based at least in part on the disparity vector associated with the block and the depth map:
provides a disparity vector associated with the first sub block that comprises an increase of the offset of the disparity vector associated with the block in response to the characteristic depth value being less than or equal to a threshold or provides a disparity vector associated with the first sub block that comprises a reduction of the offset of the disparity vector associated with the block in response to the characteristic depth value being greater than the threshold.

5. The apparatus of claim 1 , comprising:
circuitry to decode the first sub block based at least in part on the disparity compensated inter-picture prediction.

6. The apparatus of claim 1 , wherein one or more of the circuitry comprises any or a combination of hardware or firmware.

7. The apparatus of claim 1 , comprising:
circuitry to decode the first sub block based at least in part on the calibrated disparity vector;
a radio communicatively coupled to the circuitry to decode the first sub block; and
at least one antenna communicatively coupled to the radio.

8. The apparatus of claim 7 , comprising:
one or more processor circuitry;
at least one memory communicatively coupled to the one or more processor circuitry; and
a display communicatively coupled to the one or more processor circuitry, the display to display a decoded sub block.

9. A computer-implemented method for three dimensional (3D) video decoding, the method comprising:
partitioning a block of a first picture into two or more sub blocks of the block including a first sub block and a second sub block;
accessing a depth map associated with the block;
accessing a disparity vector associated with the block, wherein the disparity vector provides disparity compensated prediction by referencing an already decoded second picture having a different view with respect to the first picture;
selectively determining a calibrated disparity vector for the first sub block based at least in part on the disparity vector associated with the block and the depth map by determining, using the depth map, a characteristic depth value corresponding to the first sub block and calibrating the disparity vector associated with the block based on the characteristic depth value to generate the calibrated disparity vector for the first sub block, wherein calibrating the disparity vector to generate the calibrated disparity vector provides the calibrated disparity vector for the first sub block as a modification of the disparity vector associated with the block based at least in part on a scaling factor and an offset factor, wherein the scaling factor and the offset factor are determined based on the characteristic depth value; and
performing disparity compensated inter-prediction for the first sub block based on the calibrated disparity vector associated with the first sub block.

10. The method of claim 9 , wherein the characteristic depth value is an average depth value of multiple depth values corresponding to the first sub block.

11. The method of claim 9 , wherein the characteristic depth value is a median depth value of multiple depth values corresponding to the first sub block.

12. The method of claim 9 , wherein selectively determining the calibrated disparity vector for the first sub block based at least in part on the disparity vector associated with the block and the depth map comprises:
providing a disparity vector associated with the first sub block that comprises an increase of the offset of the disparity vector associated with the block in response to the characteristic depth value being less than or equal to a threshold or providing a disparity vector associated with the first sub block that comprises a reduction of the offset of the disparity vector associated with the block in response to the characteristic depth value being greater than the threshold.

13. The method of claim 9 , comprising:
decoding the first sub block based at least in part on the disparity compensated inter-picture prediction.

14. The method of claim 9 , comprising:
decoding the first sub block based at least in part on the calibrated disparity vector.

15. At least one non-transitory computer-readable medium comprising instructions stored thereon, which when executed by a computer, cause the computer to:
partition a block of a first picture into two or more sub blocks of the block including a first sub block and a second sub block;
access a depth map associated with the block;
access a disparity vector associated with the block, wherein the disparity vector provides disparity compensated prediction by referencing an already decoded second picture having a different view with respect to the first picture;
selectively determine a calibrated disparity vector for the first sub block based at least in part on the disparity vector associated with the block and the depth map, wherein to selectively determine the calibrated disparity vector, the computer determines, using the depth map, a characteristic depth value corresponding to the first sub block and calibrates the disparity vector associated with the block based on the characteristic depth value to generate the calibrated disparity vector for the first sub block, wherein to calibrate the disparity vector to generate the calibrated disparity vector, the computer provides the calibrated disparity vector for the first sub block as a modification of the disparity vector associated with the block based at least in part on a scaling fac

Assignees

• Zhang Wenhao
• Chiu Yi-Jen
• Xu Lidong
• Han Yu
• Deng Zhipin
• Intel Corp

Inventors

• Zhang Wenhao
• Chiu Yi-Jen
• Xu Lidong
• Han Yu
• Deng Zhipin

Classifications

• H04N13/161 Primary

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N19/597

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/513

  Processing of motion vectors · CPC title

• H04N13/0048 Primary

  Electricity · mapped topic