Dynamic mesh coding with simplified topology

Patent metadata

Field	Value
Publication number	US-12536710-B2
Application number	US-202218725374-A
Country	US
Kind code	B2
Filing date	Dec 28, 2022
Priority date	Dec 29, 2021
Publication date	Jan 27, 2026
Grant date	Jan 27, 2026

Abstract

In some embodiments, a mesh encoder encodes a dynamic mesh with connectivity simplification. The encoder encodes geometry component images of the dynamic mesh using a video encoder to generate a geometry component bitstream and decodes the geometry component bitstream to generate reconstructed geometry component images. The encoder further determines, using the reconstructed geometry component images, a face to be removed from connectivity component images of the dynamic mesh and updates the connectivity component images of the dynamic mesh by removing the face from the connectivity component images. The encoder encodes the updated connectivity component images to generate a connectivity component bitstream and generates a coded mesh bitstream by including at least the geometry component bitstream and the connectivity component bitstream.

First claim

The invention claimed is:

1 . A computer-implemented method for decoding a coded mesh bitstream of a dynamic mesh, the method comprising:
reconstructing geometry information of the dynamic mesh from a geometry component bitstream in the coded mesh bitstream; reconstructing connectivity information of the dynamic mesh from a connectivity component bitstream in the coded mesh bitstream; refining reconstructed connectivity information based on reconstructed geometry information to generate refined connectivity information; reconstructing the dynamic mesh based on the reconstructed geometry information and the refined connectivity information; and rendering a reconstructed dynamic mesh for display, wherein refining the reconstructed connectivity information based on the reconstructed geometry information to generate the refined connectivity information comprises: identifying a vertex located inside a face specified by the reconstructed connectivity information based on the reconstructed geometry information; and dividing the face into two refined faces according to a location of the vertex to generate the refined connectivity information.

2 . The computer-implemented method of claim 1 , wherein the reconstructed connectivity information comprises data specifying faces of the dynamic mesh.

3 . The computer-implemented method of claim 1 , wherein a face of the dynamic mesh is a triangle.

4 . The computer-implemented method of claim 1 , wherein the vertex is specified in the reconstructed geometry information and is not listed as a vertex of any faces specified by the reconstructed connectivity information.

5 . The computer-implemented method of claim 1 , wherein dividing the face into the two refined faces according to the location of the vertex comprises:
determining a projected vertex of the vertex on an edge of the face; and dividing the face into the two refined faces, wherein each of the two refined faces has the projected vertex as one vertex and has a same orientation as the face.

6 . The computer-implemented method of claim 1 , wherein the coded mesh bitstream comprises the geometry component bitstream, the connectivity component bitstream, an attribute component bitstream, and a mapping component bitstream.

7 . The computer-implemented method of claim 1 , wherein reconstructing the dynamic mesh based on the reconstructed geometry information and the refined connectivity information comprises:
reconstructing the dynamic mesh based on the reconstructed geometry information, the refined connectivity information, and at least one of attribute information and mapping information.

8 . A mesh decoder, comprising:
a memory; and a processor communicatively coupled to the memory, wherein the processor is configured to execute computer-executable program codes stored in the memory to perform operations of:
reconstructing geometry information of a dynamic mesh from a geometry component bitstream in a coded mesh bitstream;
reconstructing connectivity information of the dynamic mesh from a connectivity component bitstream in the coded mesh bitstream;
refining reconstructed connectivity information based on reconstructed geometry information to generate refined connectivity information;
reconstructing the dynamic mesh based on the reconstructed geometry information and the refined connectivity information; and
rendering a reconstructed dynamic mesh for display,
wherein refining the reconstructed connectivity information based on the reconstructed geometry information to generate the refined connectivity information comprises:
identifying a vertex located inside a face specified by the reconstructed connectivity information based on the reconstructed geometry information; and
dividing the face into two refined faces according to a location of the vertex to generate the refined connectivity information.

9 . The mesh decoder of claim 8 , wherein the reconstructed connectivity information comprises data specifying faces of the dynamic mesh.

10 . The mesh decoder of claim 8 , wherein a face of the dynamic mesh is a triangle.

11 . The mesh decoder of claim 8 , wherein the vertex is specified in the reconstructed geometry information and is not listed as a vertex of any faces specified by the reconstructed connectivity information.

12 . The mesh decoder of claim 8 , wherein dividing the face into the two refined faces according to the location of the vertex comprises:
determining a projected vertex of the vertex on an edge of the face; and dividing the face into the two refined faces, wherein each of the two refined faces has the projected vertex as one vertex and has a same orientation as the face.

13 . The mesh decoder of claim 8 , wherein the coded mesh bitstream comprises the geometry component bitstream, the connectivity component bitstream, an attribute component bitstream, and a mapping component bitstream.

14 . The mesh decoder of claim 8 , wherein reconstructing the dynamic mesh based on the reconstructed geometry information and the refined connectivity information comprises:
reconstructing the dynamic mesh based on the reconstructed geometry information, the refined connectivity information, and at least one of attribute information and mapping information.

Assignees

• Guangdong Oppo Mobile Telecommunications Corp Ltd

Inventors

• Zakharchenko Vladyslav
• Yu Yue
• Yu Haoping

Classifications

• G06T2210/56

  Particle system, point based geometry or rendering · CPC title

• G06T2210/36

  Level of detail · CPC title

• G06T17/205

  Re-meshing · CPC title

• G06T17/20

  Finite element generation, e.g. wire-frame surface description, {tesselation} · CPC title

• G06T9/20

  Contour coding, e.g. using detection of edges · CPC title