Methods and systems to modify a two dimensional facial image to increase dimensional depth and generate a facial image that appears three dimensional

Patent metadata

Field	Value
Publication number	US-10650539-B2
Application number	US-201816041529-A
Country	US
Kind code	B2
Filing date	Jul 20, 2018
Priority date	Dec 6, 2016
Publication date	May 12, 2020
Grant date	May 12, 2020

Abstract

The specification describes methods and systems for increasing a dimensional depth of a two-dimensional image of a face to yield a face image that appears three dimensional. The methods and systems identify key points on the 2-D image, obtain a texture map for the 2-D image, determines one or more proportions within the 2-D image, and adjusts the texture map of the 3-D model based on the determined one or more proportions within the 2-D image.

First claim

We claim:

1. A computer-implemented method for generating a facial image that appears three dimensional from a two-dimensional facial image, the method being implemented in at least one computer having a processor and a random access memory, the method comprising:
acquiring the two-dimensional facial image from a storage unit;
using the at least one computer, generating a texture map of the two-dimensional facial image;
using the at least one computer, projecting the texture map of the two-dimensional facial image onto a three-dimensional mesh image;
using the at least one computer, determining a first set of one or more positional relationships between anatomical features in the two-dimensional facial image;
using the at least one computer, determining a second set of one or more positional relationships between anatomical features in the three-dimensional mesh image;
using the at least one computer, determining a plurality of scaling factors, wherein each of said scaling factors is a function of at least one of the first set of one or more positional relationships and at least one of the second set of one or more positional relationships;
using the at least one computer, adjusting the three-dimensional mesh image based on the determined plurality of scaling factors to yield the facial image that appears three dimensional; and
using the at least one computer, outputting the facial image that appears three dimensional.

2. The computer-implemented method of claim 1 , wherein each of the plurality of scaling factors is a ratio of the at least one of the first set of one or more positional relationships and the at least one of the second set of one or more positional relationships.

3. The computer-implemented method of claim 1 , wherein the determining the first set of one or more positional relationships between anatomical features in the two-dimensional facial image comprises determining proportions from measurements between at least two anatomical positions on a face in the facial image.

4. The computer-implemented method of claim 3 , wherein the determining proportions from measurements between at least two anatomical positions on the face comprises determining a first anatomical distance, determining a second anatomical distance and computing a function of the first anatomical distance and the second anatomical distance.

5. The computer-implemented method of claim 4 , wherein the first anatomical distance is at least one of a lateral face width, a lateral jaw width, a lateral temple width, a lateral eyebrow width, a lateral chin width, a lateral lip width, or a lateral nose width and wherein the second anatomical distance is a distance between two temples of the face.

6. The computer-implemented method of claim 4 , wherein the first anatomical distance is at least one of a vertically defined lip thickness, a vertical distance between a nose and a nose bridge, a vertical distance between a lip and a nose bridge, a vertical distance between a chin and a nose bridge, a vertical eye length, or a vertical distance between a jaw and a nose bridge and wherein the second anatomical distance is at least one of a distance between two anatomical positions on said face or a distance between two temples of the face.

7. The computer-implemented method of claim 4 , wherein the first anatomical distance is a distance between two anatomical positions on face and the second anatomical distance is a distance between a point located proximate a left edge of a left eyebrow of the face and a point located proximate a right edge of a right eyebrow of the face.

8. The computer-implemented method of claim 1 , wherein the determining the second set of one or more positional relationships between anatomical features in the three-dimensional mesh image comprises determining a first anatomical distance in a face in the three-dimensional mesh image, determining a second anatomical distance in the face and computing a function of the first anatomical distance and the second anatomical distance.

9. The computer-implemented method of claim 8 , wherein the first anatomical distance is at least one of a lateral face width, a lateral jaw width, a lateral temple width, a lateral eyebrow width, a lateral chin width, a lateral lip width, or a lateral nose width and wherein the second anatomical distance is a distance between two temples of the face.

10. The computer-implemented method of claim 8 , wherein the first anatomical distance is at least one of a vertically defined lip thickness, a vertical distance between a nose and a nose bridge, a vertical distance between a lip and a nose bridge, a vertical distance between a chin and a nose bridge, a vertical eye length, or a vertical distance between a jaw and a nose bridge and wherein the second anatomical distance is at least one of a distance between two anatomical positions on said face or a distance between two temples of the face.

11. The computer-implemented method of claim 8 , wherein the first anatomical distance is a distance between two anatomical positions on face and the second anatomical distance is a distance between a point located proximate a left edge of a left eyebrow of the face and a point located proximate a right edge of a right eyebrow of the face.

12. The computer-implemented method of claim 1 further comprising processing the two-dimensional facial image to validate a presence of a frontal image of the face.

13. A computer readable non-transitory medium comprising a plurality of executable programmatic instructions wherein, when said plurality of executable programmatic instructions are executed by a processor, a process for generating a facial image that appears three dimensional from a two-dimensional facial image is executed, the plurality of executable programmatic instructions comprising:
programmatic instructions, stored in the computer readable non-transitory medium, for acquiring the two-dimensional facial image from a storage unit;
programmatic instructions, stored in the computer readable non-transitory medium, for generating a texture map of the two-dimensional facial image;
programmatic instructions, stored in the computer readable non-transitory medium, for translating the texture map of the two-dimensional facial image onto a three-dimensional mesh image;
programmatic instructions, stored in the computer readable non-transitory medium, for determining a first set of one or more positional relationships between anatomical features in the two-dimensional facial image;
programmatic instructions, stored in the computer readable non-transitory medium, for determining a second set of one or more positional relationships between anatomical features in the three-dimensional mesh image;
programmatic instructions, stored in the computer readable non-transitory medium, for determining a plurality of scaling factors, wherein each of said scaling factors is a function of at least one of the first set of one or more positional relationships and at least one of the second set of one or more positional relationships;
programmatic instructions, stored in the computer readable non-transitory medium, for adjusting the three-dimensional mesh image based on the determined plurality of scaling factors to yield the facial image that appears three dimensional; and
programmatic instructions, stored in the computer readable non-transitory medium, for outputting the facial image that appears three dimensional.

14. The computer readable non-transitory medium of claim 13 , wherein each of the plurality of scaling factors is a ratio of the at least one of the first set of one or more positional relationships an

Assignees

• Activision Publishing Inc

Inventors

• Yan Paul D
• Vorachart Thitikun

Classifications

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06T7/50 Primary

  Depth or shape recovery · CPC title

• G06K9/00268

  Physics · mapped topic

• G06K9/00208

  Physics · mapped topic

• G06K9/621

  Physics · mapped topic