Combining shapes for animation

Patent metadata

Field	Value
Publication number	US-9183660-B2
Application number	US-201314090686-A
Country	US
Kind code	B2
Filing date	Nov 26, 2013
Priority date	Dec 21, 2009
Publication date	Nov 10, 2015
Grant date	Nov 10, 2015

Abstract

A system includes a computing device that includes a memory for storing instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes combining, in a nonlinear manner, a first set of vertex displacements that represent the difference between a first animated expression and a neutral animated expression with a second set of vertex displacements that represent the difference between a second animated expression and the neutral animated expression. The number of vertices associated with the first set of vertex displacements of the first animated expression is equivalent to the number of vertices associated with the second set of vertex displacements of the second animated expression.

First claim

What is claimed is:

1. A computer implemented method comprising:
receiving a first set of weights for a first blendshape to be applied to a neutral animated expression, the first blendshape comprising a first set of vertex displacements that represents the difference between a first animated expression and the neutral animated expression;
receiving a second set of weights for a second blendshape to be applied to the neutral animated expression, the second blendshape comprising a second set of vertex displacements that represents the difference between a second animated expression and the neutral animated expression;
for common vertices in the neutral animated expression that are associated with both the first blendshape and the second blendshape, generating a third set of vertex displacements by combining, in a nonlinear manner, data comprising:
weights from the first set of weights and displacements from the first set of vertex displacements corresponding to the common vertices; and
weights from the second set of weights and displacements from the second set of vertex displacements corresponding to the common vertices;

applying, with one or more processors, the third set of vertex displacements to the common vertices to move the common vertices in the neutral animated expression to new locations and thereby produce a new animated expression; and
rendering the new animated expression to generate a two-dimensional image for display on a display device.

2. The computer implemented method of claim 1 , wherein combining, in a nonlinear manner, includes a combination of nonlinear and linear operations.

3. The computer implemented method of claim 1 , wherein combining includes determining an expected value of at least one vertex displacement included in the first set of vertex displacements and a corresponding vertex displacement included in the second set of vertex displacements.

4. The computer implemented method of claim 1 , wherein combining, in a nonlinear manner, includes biasing the first set of vertex displacements that represent the difference between the first animated expression and the neutral animated expression.

5. The computer-implemented method of claim 1 , wherein combining, in a nonlinear manner, includes determining if a vertex displacement included in the first set of vertex displacements extends in a direction equivalent to a corresponding vertex displacement included in the second set of vertex displacements.

6. The computer implemented method of claim 5 , wherein combining, in a nonlinear manner, includes applying a weight to the vertex displacement in the first set of vertex displacements that extends in the direction equivalent to the corresponding vertex displacement included in the second set of vertex displacements.

7. The computer-implemented method of claim 1 , wherein combining, in a nonlinear manner, includes applying a weight that has an upper limit to at least one vertex displacement included in the first set of vertex displacements.

8. The computer-implemented method of claim 1 , wherein combining, in a nonlinear manner, includes applying a weight that is a normal of the first set of vertex displacements and the second set of vertex displacements to at least one displacement of the combined first and second set of vertex displacements.

9. The computer-implemented method of claim 1 , wherein the first animated expression includes a facial expression of an animated character.

10. The computer-implemented method of claim 1 , wherein combining, in a nonlinear manner, is initiated by user input.

11. A computer program product tangibly embodied in an information carrier and comprising instructions that when executed by a processor perform a method comprising:
receiving a first set of weights for a first blendshape to be applied to a neutral animated expression, the first blendshape comprising a first set of vertex displacements that represents the difference between a first animated expression and the neutral animated expression;
receiving a second set of weights for a second blendshape to be applied to the neutral animated expression, the second blendshape comprising a second set of vertex displacements that represents the difference between a second animated expression and the neutral animated expression;
for common vertices in the neutral animated expression that are associated with both the first blendshape and the second blendshape, generating a third set of vertex displacements by combining, in a nonlinear manner, data comprising:
weights from the first set of weights and displacements from the first set of vertex displacements corresponding to the common vertices; and
weights from the second set of weights and displacements from the second set of vertex displacements corresponding to the common vertices;

applying the third set of vertex displacements to the common vertices to move the common vertices in the neutral animated expression to new locations and thereby produce a new animated expression; and
rendering the new animated expression to generate a two-dimensional image for display on a display device.

12. The computer program product of claim 11 , wherein combining, in a nonlinear manner, includes a combination of nonlinear and linear operations.

13. The computer program product of claim 11 , wherein combining includes determining an expected value of at least one vertex displacement included in the first set of vertex displacements and a corresponding vertex displacement included in the second set of vertex displacements.

14. The computer program product of claim 11 , wherein combining, in a nonlinear manner, includes biasing the first set of vertex displacements that represent the difference between the first animated expression and the neutral animated expression.

15. The computer program product of claim 11 , wherein combining, in a nonlinear manner, includes determining if a vertex displacement included in the first set of vertex displacements extends in a direction equivalent to a corresponding vertex displacement included in the second set of vertex displacements.

16. The computer program product of claim 15 , wherein combining, in a nonlinear manner, includes applying a weight to the vertex displacement in the first set of vertex displacements that extends in the direction equivalent to the corresponding vertex displacement included in the second set of vertex displacements.

17. The computer program product of claim 11 , wherein combining, in a nonlinear manner wherein combining, in a nonlinear manner, includes applying a weight that has an upper limit to at least one vertex displacement included in the first set of vertex displacements.

18. The computer program product of claim 11 , wherein combining, in a nonlinear manner, includes applying a weight that is a normal of the first set of vertex displacements and the second set of vertex displacements to at least one displacement of the combined first and second set of vertex displacements.

19. The computer program product of claim 11 , wherein the first animated expression includes a facial expression of an animated character.

20. The computer program product of claim 11 , wherein combining, in a nonlinear manner, is initiated by user input.

21. A system comprising:
a computing device comprising:
a memory configured to store instructions; and
a processor configured to execute the instructions to perform a method comprising:
receiving a first set of weights for a first blendshape to be applied to

Assignees

• Lucasfilm Entertainment Co Ltd
• Lucasfilm Entertainment Co Ltd

Inventors

• Koperwas Michael
• Pighin Frederic P

Classifications

• G06F18/28

  Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries · CPC title

• G06T2219/2021

  Shape modification · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06T13/20 Primary

  Three-dimensional [3D] animation · CPC title