Submesh coding for dynamic mesh coding

Patent metadata

Field	Value
Publication number	US-12413747-B2
Application number	US-202318391526-A
Country	US
Kind code	B2
Filing date	Dec 20, 2023
Priority date	Jan 12, 2023
Publication date	Sep 9, 2025
Grant date	Sep 9, 2025

Abstract

An apparatus comprises a communication interface and a processor operably coupled to the communication interface. The communication interface is configured to receive a compressed bitstream including association information between scene objects and submeshes. The processor is configured to determine an index of a scene object, decode the association information between scene objects and submeshes, determine an identifier of a submesh based on the association information and the index of the scene object, and reconstruct the submesh based on the identifier.

First claim

What is claimed is:

1. An apparatus for reconstructing a three-dimensional (3D) sub-mesh of a 3D mesh comprising a processor configured to:
receive a compressed bitstream including a supplemental enhancement information (SEI) message including association information between scene objects and submeshes, wherein the association information includes a plurality of indices of the scene objects and a plurality of identifiers of the plurality of submeshes each being associated with a respective one index of the plurality of indices of the scene objects and each of the submeshes is independently decodable from other submeshes;
determine an index of the scene object;
decode the SEI message to obtain the association information between scene objects and submeshes;
determine an identifier of a submesh based on the index of the scene object and the association information; and
reconstruct the submesh based on the identifier.

2. The apparatus of claim 1 , wherein the association information further includes first number information indicating a number of scene objects specified in the association information.

3. The apparatus of claim 2 , wherein the association information further includes second number information indicating a number of the plurality of identifiers of the plurality of submeshes.

4. The apparatus of claim 3 , wherein the association information further includes information indicating whether a respective one submesh of the plurality of the submesh is completely included in a scene object associated with the respective one submesh.

5. The apparatus of claim 1 , wherein the compressed bitstream further includes 3D bounding box information specifying association between 3D bounding boxes and submeshes, and
the index of the scene object is determined based on the 3D bounding box information.

6. The apparatus of claim 1 , wherein the compressed bitstream further includes visibility cones information specifying association between visibility cones and submeshes, and the index of the scene object is determined based on the visibility cones information.

7. The apparatus of claim 1 , wherein the association information further includes persistence information indicating whether a relationship between the scene objects and submeshes specified by the association information is persistent.

8. A method for reconstructing a three-dimensional (3D) sub-mesh of a 3D mesh comprising:
receiving a compressed bitstream including a supplemental enhancement information (SEI) message including association information between scene objects and submeshes, wherein the association information includes a plurality of indices of the scene objects and a plurality of identifiers of the plurality of submeshes each being associated with a respective one index of the plurality of indices of the scene objects;
determining an index of the scene object;
decoding the SEI message to obtain the association information between scene objects and submeshes;
determining an identifier of a submesh based on the index of the scene object and the association information; and
reconstructing the submesh based on the identifier.

9. The method of claim 8 , wherein the association information further includes first number information indicating a number of scene objects specified in the association information.

10. The method of claim 9 , wherein the association information further includes second number information indicating a number of the plurality of identifiers of the plurality of submeshes.

11. The method of claim 10 , wherein the association information further includes information indicating whether a respective one submesh of the plurality of the submesh is completely included in a scene object associated with the respective one submesh.

12. The method of claim 8 , wherein the compressed bitstream further includes 3D bounding box information specifying association between 3D bounding boxes and submeshes, and
the index of the scene object is determined based on the 3D bounding box information.

13. The method of claim 8 , wherein the compressed bitstream further includes visibility cones information specifying association between visibility cones and submeshes, and
the index of the scene object is determined based on the visibility cones information.

14. The method of claim 8 , wherein the association information further includes persistence information indicating whether a relationship between the scene objects and submeshes specified by the association information is persistent.

15. An apparatus for encoding a three-dimensional (3D) sub-mesh of a 3D mesh comprising:
a communication interface; and
a processor operably coupled to the communication interface, the processor configured to:
divide a base mesh into a plurality of submeshes,
encode a submesh of the plurality of submeshes independently from other submeshes,
encode a supplemental enhancement information (SEI) message including association information between scene objects and submeshes, wherein the association information includes a plurality of indices of the scene objects and a plurality of identifiers of the plurality of submeshes each being associated with a respective one index of the plurality of indices of the scene objects, and
combine the encoded submesh and the encoded SEI message into a compressed bitstream.

16. The apparatus of claim 15 , wherein the compressed bitstream further includes 3D bounding box information specifying association between 3D bounding boxes and submeshes.

17. The apparatus of claim 15 , wherein the compressed bitstream further includes visibility cones information specifying association between visibility cones and submeshes.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lim Youngkwon
• Joshi Rajan Laxman
• Budagavi Madhukar

Classifications

• H04N19/597

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/17 Primary

  the unit being an image region, e.g. an object · CPC title