Physical face cloning

Patent metadata

Field	Value
Publication number	US-10403404-B2
Application number	US-201514797755-A
Country	US
Kind code	B2
Filing date	Jul 13, 2015
Priority date	Jan 18, 2011
Publication date	Sep 3, 2019
Grant date	Sep 3, 2019

Abstract

A computer-implemented method is provided for physical face cloning to generate a synthetic skin. Rather than attempt to reproduce the mechanical properties of biological tissue, an output-oriented approach is utilized that models the synthetic skin as an elastic material with isotropic and homogeneous properties (e.g., silicone rubber). The method includes capturing a plurality of expressive poses from a human subject and generating a computational model based on one or more material parameters of a material. In one embodiment, the computational model is a compressible neo-Hookean material model configured to simulate deformation behavior of the synthetic skin. The method further includes optimizing a shape geometry of the synthetic skin based on the computational model and the captured expressive poses. An optimization process is provided that varies the thickness of the synthetic skin based on a minimization of an elastic energy with respect to rest state positions of the synthetic skin.

First claim

What is claimed is:

1. A method for generating an object shape for a synthetic skin, the method comprising:
determining a first target surface and a second target surface, wherein the first target surface comprises a neutral target pose, and the second target surface comprises an expressive target pose;
generating a shape geometry for the synthetic skin, the shape geometry having an outer surface and an inner surface, wherein the outer surface is determined based on the first target surface comprising the neutral target pose;
generating one or more material parameters for the synthetic skin based on a computational model that simulates deformation behavior of a fabricated object having the shape geometry and made from a defined physical material, such that the outer surface of the shape geometry in a deformed state more closely matches the expressive target pose of the second target surface; and
fabricating the synthetic skin based on the shape geometry and the one or more material parameters, wherein the one or more material parameters define physical attributes of the synthetic skin.

2. The method of claim 1 , further comprising:
determining one or more actuator parameters associated with the second target surface for controlling a corresponding mechanical actuator configured to deform the synthetic skin, wherein the actuator parameters are selected to deform the shape geometry in a manner such that the outer surface of the deformed shape geometry matches the second target surface.

3. The method of claim 1 , further comprising:
generating the computational model based on one or more material parameters of a material, wherein the computational model is configured to simulate deformation behavior of an object fabricated from the material.

4. The method of claim 1 , further comprising:
capturing stress-strain behavior of a sample comprised of a material; and
determining one or more material parameters based on an objective function minimized to approximate the captured stress-strain behavior; and
generating the computational model based on the one or more material parameters.

5. The method of claim 1 , further comprising:
determining an operational range of an animatronic device comprising a plurality of attachment paths; and
modifying the computational model by utilizing the determined operational range as boundary constraint for forward simulation.

6. The method of claim 1 , wherein modifying the inner surface comprises:
determining an energy minimization function based on the computational model, wherein the computational model comprises a neo-Hookean material model configured to simulate a deformed state of the shape geometry based on a plurality of material parameters; and
modifying the shape geometry based on the energy minimization function.

7. The method of claim 1 , wherein modifying the inner surface comprises:
determining how closely the outer surface of the shape geometry in the deformed state matches the second target surface according to an objective function comprising a matching energy function representing a level of conformity of an input surface to the second target surface.

8. The method of claim 1 , wherein the shape geometry further comprises one or more object parameters that represent a property selected from a group consisting of material distribution, thickness, density, and stiffness.

9. A non-transitory computer-readable storage medium containing computer program code, that, when executed, performs an operation to generate an object shape for a synthetic skin, the operation comprising:
determining a first target surface and a second target surface, wherein the first target surface comprises a neutral target pose, and the second target surface comprises an expressive target pose;
generating a shape geometry having an outer surface and an inner surface, wherein the outer surface is determined based on the first target surface comprising the neutral target pose;
generating one or more material parameters for the synthetic skin based on a computational model that simulates deformation behavior of a fabricated object having the shape geometry and made from a defined physical material, such that the outer surface of the shape geometry in a deformed state more closely matches the expressive target pose of the second target surface; and
fabricating the synthetic skin based on the shape geometry and the one or more material parameters, wherein the one or more material parameters define physical attributes of the synthetic skin.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the operation further comprises:
determining one or more actuator parameters associated with the second target surface for controlling a corresponding mechanical actuator configured to deform the synthetic skin, wherein the actuator parameters are selected to deform the shape geometry in a manner such that the outer surface of the deformed shape geometry matches the second target surface.

11. The non-transitory computer-readable storage medium of claim 9 , wherein the operation further comprises:
generating the computational model based on one or more material parameters of a material, wherein the computational model is configured to simulate deformation behavior of an object fabricated from the material.

12. The non-transitory computer-readable storage medium of claim 9 , wherein the operation further comprises:
capturing stress-strain behavior of a sample comprised of a material; and
determining one or more material parameters based on an objective function minimized to approximate the captured stress-strain behavior; and
generating the computational model based on the one or more material parameters.

13. The non-transitory computer-readable storage medium of claim 9 , wherein the operation further comprises:
determining an operational range of an animatronic device comprising a plurality of attachment paths; and
modifying the computational model by utilizing the determined operational range as boundary constraint for forward simulation.

14. The non-transitory computer-readable storage medium of claim 9 , wherein the operation comprising modifying the inner surface further comprises:
determining an energy minimization function based on the computational model, wherein the computational model comprises a neo-Hookean material model configured to simulate a deformed state of the shape geometry based on a plurality of material parameters; and
modifying the shape geometry based on the energy minimization function.

15. The non-transitory computer-readable storage medium of claim 9 , wherein the operation comprising modifying the inner surface further comprises:
determining how closely the outer surface of the shape geometry in the deformed state matches the second target surface according to an objective function comprising a matching energy function representing a level of conformity of an input surface to the second target surface.

16. The non-transitory computer-readable storage medium of claim 9 , wherein the shape geometry further comprises one or more object parameters that represent a property selected from a group consisting of material distribution, thickness, density, and stiffness.

17. A system to generate an object shape for a synthetic skin, the system comprising:
one or more computer processors; and
a memory containing a program which when executed by the processors performs an operation comprising:
determining a first target surface and a second target surface, wherein the first target surface comprises a n

Assignees

• Disney Entpr Inc
• Eth Zurich Eidgenoessiche Technische Hochschule Zurich

Inventors

• Bickel Bernd
• Kaufmann Peter
• Thomaszewski Bernhard
• Bradley Derek Edward
• Jackson Philip John
• Marschner Stephen R
• Matusik Wojciech
• Gross Markus
• Beeler Thabo Dominik

Classifications

• G06F30/23

  using finite element methods [FEM] or finite difference methods [FDM] · CPC title

• G06T2207/30201

  Face · CPC title

• G06T2219/2021

  Shape modification · CPC title

• G16H50/50 Primary

  for simulation or modelling of medical disorders · CPC title

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title