Method and apparatus for encoding volumetric video represented as a multiplane image

Patent metadata

Field	Value
Publication number	US-12356006-B2
Application number	US-202118027754-A
Country	US
Kind code	B2
Filing date	Sep 16, 2021
Priority date	Sep 22, 2020
Publication date	Jul 8, 2025
Grant date	Jul 8, 2025

Abstract

A method and a device for generating a data stream representative of a volumetric video generated from a sequence of multi-plane images are disclosed. A quantization law depending on an angular resolution used to generate patches from the multi-plane images is set up. For each intra-periods of the frame sequence, patches are generated for a given angular resolution. If generated patches do not fit in atlas images of a target size, the angular resolution is decreased and patches are generated again according to this new angular resolution.

First claim

The invention claimed is:

1. A method comprising:
generating patches by aggregating not totally transparent parts of a multi-plane image and by using a quantization law depending on an angular resolution, wherein the multi-plane image comprises a number of layers and is representative of a three-dimensional scene;
determining that the generated patches cannot be packed in an atlas image of a given size; and
responsive to the determining, decreasing the angular resolution and repeating generating patches.

2. The method of claim 1 , wherein the quantization law requires a lower number of layers of the multi-plane image when the angular resolution decreases or a viewing excursion decreases.

3. The method of claim 1 , wherein the quantization law further depends on a viewing excursion associated with the three-dimensional scene.

4. A method for generating a sequence of atlas images from a sequence of multi-plane images according to claim 1 , wherein the generated sequence of atlas images is encoded as an intra-period of a video stream.

5. A device comprising a processor configured to perform:
generating patches by aggregating non totally transparent parts of a multi-plane image and by using a quantization law depending on an angular resolution, wherein the multi-plane image comprises a number of layers and is representative of a three-dimensional scene;
determining that the generated patches cannot be packed in an atlas image of a given size; and
responsive to the determining, decreasing the angular resolution and repeating generating patches.

6. The device of claim 5 , wherein the quantization law requires a lower number of layers of the multi-plane image when the angular resolution decreases or a viewing excursion decreases.

7. The device of claim 5 , wherein the quantization law further depends on a viewing excursion associated with the three-dimensional scene.

8. A device comprising a processor configured to perform generating a sequence of atlas images from a sequence of multi-plane images according to the method of claim 1 , wherein the generated sequence of atlas images is encoded as an intra-period of a video stream.

9. The method of claim 4 , wherein the quantization law further depends on a viewing excursion associated with the three-dimensional scene.

10. The method of claim 4 , wherein the quantization law requires a lower number of layers of the multi-plane image when the angular resolution decreases or a viewing excursion decreases.

11. The device of claim 8 , wherein the quantization law requires a lower number of layers of the multi-plane image when the angular resolution decreases or a viewing excursion decreases.

12. The device of claim 8 , wherein the quantization law further depends on a viewing excursion associated with the three-dimensional scene.

Assignees

• Interdigital Ce Patent Holdings Sas

Inventors

• Fleureau Julien
• Dore Renaud
• Chupeau Bertrand
• Tapie Thierry

Classifications

• H04N19/124

  Quantisation · CPC title

• G06T2200/16

  involving adaptation to the client's capabilities · CPC title

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T3/053

  Detail-in-context presentations (fisheye or wide-angle transformations G06T3/047) · CPC title

• H04N19/126

  Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers · CPC title