Method and apparatus of camera parameter signaling in 3D video coding

Patent metadata

Field	Value
Publication number	US-10477183-B2
Application number	US-201414779655-A
Country	US
Kind code	B2
Filing date	Jul 18, 2014
Priority date	Jul 19, 2013
Publication date	Nov 12, 2019
Grant date	Nov 12, 2019

Abstract

A method of three-dimensional video encoding and decoding that adaptively incorporates camera parameters in the video bitstream according to a control flag is disclosed. The control flag is derived based on a combination of individual control flags associated with multiple depth-oriented coding tools. Another control flag can be incorporated in the video bitstream to indicate whether there is a need for the camera parameters for the current layer. In another embodiment, a first flag and a second flag are used to adaptively control the presence and location of camera parameters for each layer or each view in the video bitstream. The first flag indicates whether camera parameters for each layer or view are present in the video bitstream. The second flag indicates camera parameter location for each layer or view in the video bitstream.

First claim

The invention claimed is:

1. A method of decoding three-dimensional video data for a video decoder, the method comprising:
receiving a video bitstream associated with compressed three-dimensional video data;
determining a control flag;
deriving camera parameters from the video bitstream if the control flag indicates that the camera parameters are signaled for a current layer, wherein the camera parameters are related to different views and are signaled per view;
decoding current texture data or depth data for the current layer from the video bitstream utilizing the camera parameters; and
providing decoded current texture data or depth data in the current layer,
wherein the control flag is derived based on:
(i) a combination of individual control flags associated with multiple depth-oriented coding tools, wherein at least one of the multiple depth-oriented coding tools is configured to convert depth values into disparity values using the camera parameters; and
(ii) one or more depth-oriented coding tools selected from a coding tool group, wherein the coding tool group comprises view synthesis prediction and depth-oriented neighboring block disparity vector, and

wherein the individual control flags associated with said multiple depth-oriented coding tools are signaled in a view level, picture level, or slice level of the video bitstream.

2. The method of claim 1 , wherein the control flag is derived from the individual control flags using one or more OR operations, exclusive OR operations, AND operations, or other logic operations.

3. The method of claim 1 , wherein the control flag is signaled in the video bitstream.

4. The method of claim 1 further comprising determining another control flag indicating whether there is a need for the camera parameters for the current layer, wherein if said another control flag indicates the need to signal the camera parameters for the current layer, the control flag is set to indicate that the camera parameters are signaled for the current layer.

5. The method of claim 1 , wherein said another control flag is signaled in a sequence level, the view level, the picture level or the slice level of the video bitstream.

6. The method of claim 1 , wherein the control flag is restricted by said one or more depth-oriented coding tools, and wherein the control flag is restricted to indicate that the camera parameters are signaled for the current layer if any of said one or more depth-oriented coding tools is enabled.

7. The method of claim 6 , wherein restriction information is used to indicate a selection that the control flag is restricted by said one or more depth-oriented coding tools, wherein the restriction information is implicitly derived or explicitly signaled in a sequence level, the view level, the picture level or the slice level of the video bitstream.

8. The method of claim 6 , wherein restriction information is used to indicate a selection that the control flag is restricted by said one or more depth-oriented coding tools, wherein the restriction information is implicitly derived from a same syntax header layer or a lower syntax header layer regarding whether any of said one or more depth-oriented coding tools is enabled.

9. The method of claim 1 , wherein the camera parameters in the video bitstream are incorporated in a sequence level, the view level, the picture level or the slice level of the video bitstream.

10. A method of encoding three-dimensional video data for a video encoder, the method comprising:
receiving current texture data or depth data associated with a current layer in a dependent view;
determining a control flag whether to incorporate camera parameters into a video bitstream for the current layer, wherein the camera parameters are related to different views and are signaled per view, wherein the control flag is derived based on:
(i) a combination of another control flag and individual control flags; and
(ii) one or more depth-oriented coding tools selected from a coding tool group, wherein the coding tool group comprises view synthesis prediction and depth-oriented neighboring block disparity vector,

wherein said another control flag is used to indicate a need to signal the camera parameters for the current layer, and wherein said individual control flags are associated with multiple ones of the depth-oriented coding tools is configured to convert depth values into disparity values using the camera parameters, and
wherein the individual control flags associated with said multiple ones of the depth-oriented coding tools are signaled in a view level, picture level, or slice level of the video bitstream;
incorporating information associated with the camera parameters in the video bitstream if the control flag indicates that the camera parameters are signaled for the current layer;
encoding the current texture data or depth data in the current layer utilizing the camera parameters to generate compressed data to incorporate into the video bitstream if the control flag indicates that the camera parameters are signaled for the current layer; and
providing the video bitstream.

11. The method of claim 10 , wherein the camera parameters in the video bitstream are incorporated in a sequence level, the view level, the picture level or the slice level of the video bitstream.

12. The method of claim 10 , further comprising incorporating the control flag in the video bitstream.

13. The method of claim 10 , further comprising incorporating said another control flag in a sequence level, the view level, the picture level or the slice level of the video bitstream.

14. The method of claim 10 , further comprising incorporating restriction information in a sequence level, the view level, the picture level or the slice level of the video bitstream, wherein the restriction information is used to indicate a selection that the control flag is restricted by the one or more depth-oriented coding tools, and wherein the control flag is restricted to indicate that the camera parameters are signaled for the current layer if any of said one or more depth-oriented coding tools is enabled.

15. A method of decoding three-dimensional video data for a video decoder, the method comprising:
receiving a video bitstream associated with compressed three-dimensional video data;
determining a first flag for each layer or each view, wherein the first flag indicates whether camera parameters for said each layer or each view are present in the video bitstream;
determining a second flag for each said layer or each view, wherein the second flag is derived from the first flag and indicates camera parameter location for said each layer or each view in the video bitstream, wherein the camera parameter location is derived from a logic combination of the first flag and the second flag;
deriving the camera parameters for said each layer or each view from the video bitstream from the camera parameter location if the first flag indicates that the camera parameters are present for said each layer or each view;
decoding current texture data or depth data for said each layer or each view from the video bitstream utilizing the camera parameters for said each layer or each view,
wherein at least one of the first flag and the second flag is incorporated in a view level, picture level, or slice level of the video bitstream; and
providing decoded current texture data or depth data.

16. The method of claim 15 , wherein multiple second flags are used to indicate multiple camera parameter locations in the video bitstream for said each layer or each view.

17. The

Assignees

• Hfi Innovation Inc

Inventors

• Chang Yu-Lin
• Chen Yi-Wen
• Lin Jian-Liang

Classifications

• H04N19/30

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/46 Primary

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title

• H04N13/10

  Processing, recording or transmission of stereoscopic or multi-view image signals · CPC title