Sharing of motion vector in 3D video coding

Patent metadata

Field	Value
Publication number	US-9973739-B2
Application number	US-200913124641-A
Country	US
Kind code	B2
Filing date	Oct 16, 2009
Priority date	Oct 17, 2008
Publication date	May 15, 2018
Grant date	May 15, 2018

Abstract

Joint coding of depth map video and texture video is provided, where a motion vector for a texture video is predicted from a respective motion vector of a depth map video or vice versa. For scalable video coding, depth map video is coded as a base layer and texture video is coded as an enhancement layer(s). Inter-layer motion prediction predicts motion in texture video from motion in depth map video. With more than one view in a bit stream (for multi view coding), depth map videos are considered monochromatic camera views and are predicted from each other. If joint multi-view video model coding tools are allowed, inter-view motion skip issued to predict motion vectors of texture images from depth map images. Furthermore, scalable multi-view coding is utilized, where interview prediction is applied between views in the same dependency layer, and inter-layer (motion) prediction is applied between layers in the same view.

First claim

What is claimed is:

1. A method for encoding a bitstream including a first texture picture, a first depth map picture associated with the first texture picture, a second texture picture, and a second depth map picture associated with the second texture picture, wherein the first depth map picture belongs to a first view and the second depth map picture belongs to a second view and the first depth map picture and the second depth map picture are encoded as auxiliary pictures coded independently of the corresponding texture pictures, the method comprising:
predicting the second depth map picture from the first depth map picture using a first motion vector;
predicting the second texture picture from the first texture picture using a second motion vector; and
encoding the first motion vector and the second motion vector into a bitstream.

2. A non-transitory computer-readable medium having a computer program stored thereon, the computer program comprising instructions operable to cause a processor to perform the method of claim 1 .

3. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and computer program code configured to, with the processor, cause the apparatus to:
encode a bitstream including a first texture picture, a first depth map picture associated with the first texture picture, a second texture picture, and a second depth map picture associated with a second texture picture, wherein the first depth map picture belongs to a first view and the second depth map picture belongs to a second view and the first depth map picture and the second depth map picture are encoded as auxiliary pictures coded independently of the corresponding texture pictures;
predict the second depth map picture from the first depth map picture using a first motion vector;
predict the second texture picture from the first texture picture using a second motion vector; and
encode the first motion vector and the second motion vector into a bitstream.

4. A method of decoding a bitstream including a first texture picture, a first depth map picture associated with the first texture picture, a second texture picture, and a second depth map picture associated with the second texture picture, wherein the first depth map picture belongs to a first view and the second depth map picture belongs to a second view and the first depth map picture and the second depth map picture are auxiliary pictures coded independently of the corresponding texture pictures, the method comprising:
decoding a first motion vector from a bitstream;
decoding a second motion vector from the bitstream;
decoding the second depth map picture, wherein the first motion vector is used to predict the second depth map picture from the first depth map picture; and
decoding the second texture picture, wherein the second motion vector is used to predict the second texture picture from the first texture picture.

5. A non-transitory computer-readable medium having a computer program stored thereon, the computer program comprising instructions operable to cause a processor to perform the method of claim 4 .

6. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and computer program code configured to, with the processor, cause the apparatus to:
decode a bitstream including a first texture picture, a first depth map picture associated with the first texture picture, a second texture picture, and a second depth map picture associated with a second texture picture, wherein the first depth map picture belongs to a first view and the second depth map picture belongs to a second view and the first depth map picture and the second depth map picture are auxiliary pictures coded independently of the corresponding texture pictures;
decode a first motion vector from the bitstream;
decode a second motion vector from the bitstream;
decode the second depth map picture, wherein the first motion vector is used to predict the second depth map picture from the first depth map picture; and
decode the second texture picture, wherein the second motion vector is used to predict the second texture picture from the first texture picture.

Assignees

• Chen Ying
• Hannuksela Miska
• Nokia Technologies Oy

Inventors

• Chen Ying
• Hannuksela Miska

Classifications

• H04N13/161

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N2013/0081

  Depth or disparity estimation from stereoscopic image signals · CPC title

• H04N2013/0085

  Motion estimation from stereoscopic image signals · CPC title

• H04N19/103

  Selection of coding mode or of prediction mode · CPC title

• H04N19/513

  Processing of motion vectors · CPC title