Techniques for processing reconstructed three-dimensional image data

Patent metadata

Field	Value
Publication number	US-9734628-B2
Application number	US-201514947262-A
Country	US
Kind code	B2
Filing date	Nov 20, 2015
Priority date	May 17, 2012
Publication date	Aug 15, 2017
Grant date	Aug 15, 2017

Abstract

Techniques are disclosed for creating digital assets that can be used to personalize themed products. For example, a workflow and pipeline used to generate a 3D model from digital images of a person's face and to manufacture a personalized, physical figurine customized with the 3D model are disclosed. The 3D model of the person's face may be simplified to match a topology of a desired figurine. While the topology is deformed to match that of the figurine, the 3D model retains the geometry of the child's face. Simplifying the topology of the 3D model in this manner allows the mesh to be integrated with or attached to a mesh representing desired figurine.

First claim

What is claimed is:

1. A method for processing three-dimensional (3D) graphics data, the method comprising:
removing, from a polygonal mesh representing a humanoid figure, a first plurality of vertices corresponding to a face of the humanoid figure;
adding a second plurality of vertices to the polygonal mesh, wherein the second plurality of vertices shares a common topology with the removed first plurality of vertices and has a different geometry from that of the first plurality of vertices;
aligning boundary vertices of the second plurality of vertices with boundary vertices corresponding to the face of the humanoid figure; and
applying a smoothing filter to improve a surface continuity of the polygonal mesh with the aligned boundary.

2. The method of claim 1 , wherein the first plurality of vertices does not include a set of boundary vertices of the face of the humanoid figure.

3. The method of claim 1 , wherein aligning the boundary vertices of the second plurality of vertices with the boundary vertices corresponding to the face of the humanoid figure closes any gaps between the second plurality of vertices and the polygonal mesh.

4. The method of claim 1 , wherein aligning the boundary vertices of the second plurality of vertices with the boundary vertices corresponding to the face of the humanoid figure warps a geometry of the polygonal mesh without warping the geometry of the second plurality of vertices.

5. The method of claim 1 , wherein applying the filtering process comprises:
applying a geometry smoothing filter to seam vertices along the aligned boundary and a second-ring neighborhood of the seam vertices;
applying the geometry smoothing filter to the seam vertices and a first-ring neighborhood of the seam vertices; and
applying the geometry smoothing filter to the seam vertices.

6. A computer-readable storage medium storing a program, which, when executed by a processor performs an operation for processing three-dimensional (3D) graphics data, the operation comprising:
removing, from a polygonal mesh representing a humanoid figure, a first plurality of vertices corresponding to a face of the humanoid figure;
adding a second plurality of vertices to the polygonal mesh, wherein the second plurality of vertices shares a common topology with the removed first plurality of vertices and has a different geometry from that of the first plurality of vertices;
aligning boundary vertices of the second plurality of vertices with boundary vertices corresponding to the face of the humanoid figure; and
applying a smoothing filter to improve a surface continuity of the polygonal mesh with the aligned boundary.

7. The computer-readable storage medium of claim 6 , wherein the first plurality of vertices does not include a set of boundary vertices of the face of the humanoid figure.

8. The computer-readable storage medium of claim 6 , wherein aligning the boundary vertices of the second plurality of vertices with the boundary vertices corresponding to the face of the humanoid figure closes any gaps between the second plurality of vertices and the polygonal mesh.

9. The computer-readable storage medium of claim 6 , wherein aligning the boundary vertices of the second plurality of vertices with the boundary vertices corresponding to the face of the humanoid figure warps a geometry of the polygonal mesh without warping the geometry of the second plurality of vertices.

10. The computer-readable storage medium of claim 6 , wherein applying the filtering process comprises:
applying a geometry smoothing filter to seam vertices along the aligned boundary and a second-ring neighborhood of the seam vertices;
applying the geometry smoothing filter to the seam vertices and a first-ring neighborhood of the seam vertices; and
applying the geometry smoothing filter to the seam vertices.

11. A system, comprising:
a processor; and
a memory, wherein the memory includes an application program configured to perform an for processing three-dimensional (3D) graphics data, the operation comprising:
removing, from a polygonal mesh representing a humanoid figure, a first plurality of vertices corresponding to a face of the humanoid figure, adding a second plurality of vertices to the polygonal mesh, wherein the second plurality of vertices shares a common topology with the removed first plurality of vertices and has a different geometry from that of the first plurality of vertices,
aligning boundary vertices of the second plurality of vertices with boundary vertices corresponding to the face of the humanoid figure, and
applying a smoothing filter to improve a surface continuity of the polygonal mesh with the aligned boundary.

12. The system of claim 11 , wherein the first plurality of vertices does not include a set of boundary vertices of the face of the humanoid figure.

13. The system of claim 11 , wherein aligning the boundary vertices of the second plurality of vertices with the boundary vertices corresponding to the face of the humanoid figure closes any gaps between the second plurality of vertices and the polygonal mesh.

14. The system of claim 11 , wherein aligning the boundary vertices of the second plurality of vertices with the boundary vertices corresponding to the face of the humanoid figure warps a geometry of the polygonal mesh without warping the geometry of the second plurality of vertices.

15. The system of claim 11 , wherein applying the filtering process comprises:
applying a geometry smoothing filter to seam vertices along the aligned boundary and a second-ring neighborhood of the seam vertices;
applying the geometry smoothing filter to the seam vertices and a first-ring neighborhood of the seam vertices; and
applying the geometry smoothing filter to the seam vertices.

Assignees

• Disney Entpr Inc
• ETH Zürich (Eidgenössische Technische Hochschule Zürich)

Inventors

• Tena Jose Rafael
• Mahler Moshe
• Matthews Iain
• Yeh Hengchin
• Beeler Thabo Dominik
• Sumner Robert
• Tetro Cydni
• Ngo John-Thomas C

Classifications

• G06T17/205 Primary

  Re-meshing · CPC title

• G06T17/20 Primary

  Finite element generation, e.g. wire-frame surface description, {tesselation} · CPC title

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T5/002

  Physics · mapped topic