Apparatus, a method and a computer program for video coding and decoding

Patent metadata

Field	Value
Publication number	US-9998726-B2
Application number	US-201313916977-A
Country	US
Kind code	B2
Filing date	Jun 13, 2013
Priority date	Jun 20, 2012
Publication date	Jun 12, 2018
Grant date	Jun 12, 2018

Abstract

There is disclosed a method, apparatus and computer program product in which a view synthesis prediction utilizes a depth map, disparity information or other ranging information of a co-located reference frame in another view. A first uncompressed texture block of a first texture picture representing a first view and ranging information associated with the first uncompressed texture block are obtained. Disparity information with reference to a second view is derived on the basis of the ranging information. Reference samples of the second view are obtained on the basis of the disparity information. A view synthesis prediction is performed by using the reference samples to obtain a reference block for encoding the first uncompressed texture block.

First claim

The invention claimed is:

1. A method comprising:
obtaining a first coded depth picture representing a first view;
reconstructing a first decoded depth picture based on the first coded depth picture;
obtaining a first texture block of a first texture picture representing the first view;
obtaining, from the first decoded depth picture, ranging information associated with the first texture block, wherein obtaining ranging information comprises at least one of the following:
reconstructing or decoding the first decoded depth picture representing the first view and obtaining said ranging information from the first decoded depth picture;
obtaining said ranging information from depth pictures preceding the first texture picture in coding order; or
obtaining said ranging information from texture blocks preceding the first texture block in coding order;
deriving block-wise disparity information with reference to a reference picture in a second view on the basis of the ranging information;
obtaining a location of a reference block of the second view using the block-wise disparity information as spatial coordinates offset from a location of the first texture block; and
obtaining the reference block, using view synthesis prediction, comprising reference samples for performing at least one of the following: encoding the first texture block; or decoding the first texture block;
using the disparity information for locating the reference samples in the reference picture;

obtaining reference sample values for the reference block on the basis of the located reference samples;
filtering the reference sample values; and
filtering the reference sample values using one or more weighted prediction parameters.

2. The method according to claim 1 comprising
deriving disparity information with reference to a second reference picture in a third view on the basis of the ranging information;
obtaining reference samples of the third view on the basis of the disparity information; and
using the reference samples of the second view and the reference samples of the third view to obtain the reference block.

3. The method according to claim 1 comprising deriving disparity information to specify spatial coordinates offset between samples of the first texture block and the reference samples.

4. The method according to claim 1 comprising providing at least a first reference picture list indicative of pictures used as reference pictures from which the reference block is selected.

5. The method according to claim 1 further comprising processing of the ranging information or the disparity information in at least one of the following ways:
filtering the ranging information or the disparity information;
subsampling the ranging information or the disparity information; or
deriving one disparity value from the ranging information or the disparity information.

6. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:
obtain a first coded depth picture representing a first view;
reconstruct a first decoded depth picture based on the first coded depth picture;
obtain a first texture block of a first texture picture representing the first view;
obtain, from the first decoded depth picture, ranging information associated with the first texture block by at least one of the following:
reconstructing or decoding the first decoded depth picture representing the first view and obtaining said ranging information from the first decoded depth picture;
obtaining said ranging information from depth pictures preceding the first texture picture in coding order; or
obtaining said ranging information from texture blocks preceding the first texture block in coding order;
derive block-wise disparity information with reference to a reference picture in a second view on the basis of the ranging information;
obtain a location of a reference block of the second view using the block-wise disparity information as spatial coordinates offset from a location of the first texture block; and
obtain the reference block, using view synthesis prediction, comprising reference samples for performing at least one of the following:
encoding the first texture block; or
decoding the first texture block;
use the disparity information for locating the reference samples in the reference picture;
obtain reference sample values for the reference block on the basis of the located reference samples;
filter the reference sample values; and
filter the reference sample values using one or more weighted prediction parameters.

7. The apparatus according to claim 6 said at least one memory stored with code thereon, which when executed by said at least one processor, further causes the apparatus to
derive disparity information with reference to a second reference picture in a third view on the basis of the ranging information;
obtain reference samples of the third view on the basis of the disparity information; and
use the reference samples of the second view and the reference samples of the third view to obtain the reference block.

8. The apparatus according to claim 6 , said at least one memory stored with code thereon, which when executed by said at least one processor, further causes the apparatus to derive disparity information to specify spatial coordinates offset between samples of the first texture block and the reference samples.

9. The apparatus according to claim 6 , said at least one memory stored with code thereon, which when executed by said at least one processor, further causes the apparatus to provide at least a first reference picture list indicative of pictures used as reference pictures from which the reference block is selected.

10. The apparatus according to claim 6 , said at least one memory stored with code thereon, which when executed by said at least one processor, further causes the apparatus to process of the ranging information or the disparity information in at least one of the following ways:
filtering the ranging information or the disparity information;
subsampling the ranging information or the disparity information; or
deriving one disparity value from the ranging information or the disparity information.

11. A computer program product embodied on a non-transitory computer-readable medium including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following:
obtain a first coded depth picture representing a first view;
reconstruct a first decoded depth picture based on the first coded depth picture;
obtain a first texture block of a first texture picture representing the first view;
obtain, from the first decoded depth picture, ranging information associated with the first texture block by at least one of the following:
reconstructing or decoding the first decoded depth picture representing the first view and obtaining said ranging information from the first decoded depth picture;
obtaining said ranging information from depth pictures preceding the first texture picture in coding order; or
obtaining said ranging information from texture blocks preceding the first texture block in coding order;
derive block-wise disparity information with reference to a reference picture in a second view on the basis of the ranging information;
obtain a location of a reference block of the second view using the block-wise disparity information as spatial coordinates offset from a location of the first texture block; and
obtain the r

Assignees

• Nokia Technologies Oy

Inventors

• Rusanovskyy Dmytro
• Hannuksela Miska Matias

Classifications

• H04N13/0048 Primary

  Electricity · mapped topic

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/42

  characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation (H04N19/635 takes precedence) · CPC title

• G06T7/00

  Image analysis · CPC title

• H04N13/161 Primary

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title