Method and apparatus for encoding and decoding volumetric video

Patent metadata

Field	Value
Publication number	US-12069301-B2
Application number	US-202017441051-A
Country	US
Kind code	B2
Filing date	Mar 19, 2020
Priority date	Mar 29, 2019
Publication date	Aug 20, 2024
Grant date	Aug 20, 2024

Abstract

A patch-based atlas format in intra-periods of varying length is used to encode a volumetric video. A first atlas layout is built for a first sequence of 3D scenes. The number of 3D scenes in the sequence is chosen to fit the size of a Group of Pictures of the codec. A second sequence is iteratively set up by appending the next 3D scene of the sequence to encode while the number of patches of the layout built for this iterative second sequence is lower than or equal to the number of patches of the first layout. When iterations end, one of the layouts is selected to generate every atlas of the group. In such a way, size of metadata is decreased, and compression is enhanced.

First claim

The invention claimed is:

1. A method comprising:
a. determining, via a device, a first atlas layout for a first sequence of three-dimensional (‘3D’) scenes,
wherein an atlas layout defines an organization of at least one patch within an atlas;
an atlas is a picture packing at least one patch of a same 3D scene; and
a patch is an image representative of a projection of a part of a 3D scene onto an image plane;
b. determining, via the device, a second atlas layout for a second sequence of 3D scenes, the second sequence being the first sequence to which one 3D scene is appended;
on condition that the number of patches of the second atlas layout is lower than or equal to the number of patches of the first atlas layout, using the second sequence as a first sequence for iterating steps a and b;
otherwise, generating a sequence of atlases for the first sequence of 3D scenes according to the first atlas layout and encoding the generated sequence in a data stream.

2. The method of claim 1 , further comprising:
storing the first atlas layout at each iteration; and
selecting a layout among the stored layouts to generate the sequence of atlases for the first sequence of 3D scenes when iterations end.

3. The method of claim 2 , wherein the selecting of a layout is performed on the basis of a rate-distortion optimization criterion.

4. The method of claim 1 , wherein iterations end when the second sequence of 3D scenes comprises more than a given number of 3D scenes.

5. The method of claim 1 , wherein the generated sequence of atlases is encoded as one intra-period in a video data stream.

6. The method of claim 5 , wherein the intra-period comprises at least one group of pictures comprising a number of atlases equal to the number of scenes of the initial first sequence of 3D scenes.

7. A device comprising a memory storing instructions to cause a processor to:
a. determine a first atlas layout for a first sequence of 3D scenes
wherein an atlas layout defines an organization of at least one patch within an atlas;
an atlas is a picture packing at least one patch of a same 3D scene; and
a patch is an image representative of a projection of a part of a 3D scene onto an image plane;
b. determine a second atlas layout for a second sequence of 3D scenes, the second sequence being the first sequence to which one 3D scene is appended;
on condition that the number of patches of the second atlas layout is lower than or equal to the number of patches of the first atlas layout, use the second sequence as a first sequence for iterating steps a and b;
otherwise generate a sequence of atlases for the first sequence of 3D scenes according to the first atlas layout and encode the generated sequence in a data stream.

8. The device of claim 7 , wherein the instructions are configured to cause the processor to:
store the first atlas layout at each iteration in the memory; and
select a layout among the stored layouts to generate the sequence of atlases for the first sequence of 3D scenes when iterations end.

9. The device of claim 8 , wherein the selecting of a layout is performed on the basis of a rate-distortion optimization criterion.

10. The device of claim 7 , wherein iterations end when the second sequence of 3D scenes comprises more than a given number of 3D scenes.

11. The device of claim 7 , wherein the instructions are configured to cause the processor to encode the sequence of generated atlases as one intra-period in a video data stream.

12. The device of claim 11 , wherein the group of pictures comprises at least one group of pictures comprising a number of atlases equal to the number of scenes of the initial first sequence of 3D scenes.

Assignees

• Interdigital Ce Patent Holdings Sas

Inventors

• Fleureau Julien
• Chupeau Bertrand
• Briand Gerard
• Dore Renaud
• Thudor Franck

Classifications

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T2200/04

  involving 3D image data · CPC title

• G06T19/00

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T15/08

  Volume rendering · CPC title