Makeup application assistance device, makeup application assistance method, and makeup application assistance program

Patent metadata

Field	Value
Publication number	US-10249211-B2
Application number	US-201615010224-A
Country	US
Kind code	B2
Filing date	Jan 29, 2016
Priority date	Feb 1, 2013
Publication date	Apr 2, 2019
Grant date	Apr 2, 2019

Abstract

A makeup assisting apparatus including a first image acquirer that acquires a first image of a first face, a first face portion acquirer that acquires an area of a portion of the first face, a second image acquirer that acquires a second image of a second face to which makeup is applied and a second face portion acquirer that acquires an area of a portion of the second face. A reference makeup acquirer acquires reference makeup from the second image for each of the portions of the second face based on an area of the portion of the second face, the reference makeup being a way of applying the makeup, a cosmetics information display displays cosmetics information of skin cosmetics required for applying the reference makeup, and a makeup presenter presents, to a user, the acquired makeup in association with the corresponding area of the portion of the first face.

First claim

What is claimed is:

1. A makeup assisting apparatus including a processor that executes instructions and a memory that stores the instructions and configured to:
acquire a stereo image, which comprises a first image obtained by capturing a user's face when the user's face is makeup free and generate a makeup removed image of the user's face from the first image to be used as the first image for subsequent processing when the user's face has makeup thereon;
acquire areas of a plurality of portions of the user's face from the first image;
acquire a second image, which is an image obtained by capturing a model's face to which makeup is applied;
acquire areas of a plurality of portions of the model's face from the second image;
specify an area having a color approximate to a color of a skin of the model's face, from a positional relationship between the areas of the plurality of portions of the model's face;
estimate, for each of the plurality of portions of the model's face in the second image, skin colors of the plurality of portions of the model's face in the second image, based on the color of the area specified;
acquire, from the second image, by reverse alpha blending, reference makeup and the color and concentration of the reference makeup including the level of permeability thereof and the gradation thereof for each of the plurality of portions of the model's face, based on differences between the skin colors of the plurality of portions of the second image and actual colors of the plurality of portions of the second image, the reference makeup including a way of applying the makeup;
acquire the reference makeup from a two-dimensional code displayed on an image of the model's face in a picture thereof instead of acquiring the reference makeup based on differences between the skin colors of the plurality of portions of the second image and actual colors of the plurality of portions of the second image, when acquiring the second image by capturing a picture of the model's face that includes the two-dimensional code;
display cosmetics information of skin cosmetics required for applying the reference makeup; and
transfer, with a printer, a cosmetic agent of the skin cosmetics to a peelable predetermined thin film transferable to the user's face when peeled after the printer is connected to the makeup assisting apparatus.

2. The makeup assisting apparatus according to claim 1 , the processor being further configured to control a display to display the cosmetics information associated with link information to a web site selling the skin cosmetics.

3. A makeup assisting method for a makeup assisting apparatus comprising:
acquiring a stereo image, which comprises a first image obtained by capturing a user's face when the user's face is makeup free and generate a makeup removed image of the user's face from the first image to be used as the first image for subsequent processing when the user's face has makeup thereon;
acquiring areas of a plurality of portions of the user's face from the first image;
acquiring a second image which is an image obtained by capturing a model's face to which makeup is applied;
acquiring areas of a plurality of portions of the model's face from the second image;
specifying an area having a color approximate to a color of a skin of the model's face, from a positional relationship between the areas of the plurality of portions of the model's face;
estimating, for each of the plurality of portions of the model's face in the second image, skin colors of the plurality of portions of the model's face in the second image, based on the color of the area specified;
acquiring, from the second image, by reverse alpha blending, reference makeup and the color and concentration of the reference makeup including the level of permeability thereof and the gradation thereof for each of the plurality of portions of the model's face, based on differences between the skin colors of the plurality of portions of the second image and actual colors of the plurality of portions of the second image, the reference makeup including a way of applying the makeup;
acquiring the reference makeup from a two-dimensional code displayed on an image of the model's face in a picture thereof instead of acquiring the reference makeup based on differences between the skin colors of the plurality of portions of the second image and actual colors of the plurality of portions of the second image, when acquiring the second image by capturing a picture of the model's face that includes the two-dimensional code;
displaying cosmetics information of skin cosmetics required for applying the reference makeup;
transferring, with a printer, a cosmetic agent of the skin cosmetics to a peelable predetermined thin film transferable to the user's face when peeled after the printer is connected to the makeup assisting apparatus.

4. The makeup assisting method according to claim 3 , wherein the displaying displays the cosmetics information associated with link information to a web site selling the skin cosmetics.

5. A non-transitory computer-readable storage medium comprising a make-up assisting program for a makeup assisting apparatus that causes a computer to execute processing comprising:
acquiring a stereo image, which comprises a first image obtained by capturing a user's face when the user's face is makeup free and generate a makeup removed image of the user's face from the first image to be used as the first image for subsequent processing when the user's face has makeup thereon;
acquiring areas of a plurality of portions of the user's face from the first image;
acquiring a second image which is an image obtained by capturing a model's face to which makeup is applied;
acquiring areas of a plurality of portions of the model's face from the second image;
specifying an area having a color approximate to a color of a skin of the model's face, from a positional relationship between the areas of the plurality of portions of the model face;
estimating, for each of the plurality of portions of the model's face in the second image, skin colors of the plurality of portions of the model's face in the second image, based on the color of the area specified;
acquiring, from the second image, by reverse alpha blending, reference makeup and the color and concentration of the reference makeup including the level of permeability thereof and the gradation thereof for each of the plurality of portions of the model's face, based on differences between the skin colors of the plurality of portions of the second image and actual colors of the plurality of portions of the second image, the reference makeup including a way of applying the makeup;
acquiring the reference makeup from a two-dimensional code displayed on an image of the model's face in a picture thereof instead of acquiring the reference makeup based on differences between the skin colors of the plurality of portions of the second image and actual colors of the plurality of portions of the second image, when acquiring the second image by capturing a picture of the model's face that includes the two-dimensional code;
displaying cosmetics information of skin cosmetics required for applying the reference makeup;
transferring, with a printer, a cosmetic agent of the skin cosmetics to a peelable predetermined thin film transferable to the user's face when peeled after the printer is connected to the makeup assisting apparatus.

6. The non-transitory computer-readable storage medium according to claim 5 , wherein the controlling controls a display to displays the cosmetics information associated with link information to a web site selling the skin cosmetics.

7. The makeup assisting apparatus according to claim 1 , wherein the processor
generates a

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Yamanashi Tomofumi
• Asai Rieko
• Muta Aoi
• Nishi Chie
• Ajiki Kaori

Classifications

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• A45D44/005

  for selecting or displaying personal cosmetic colours or hairstyle · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06F40/134

  Hyperlinking · CPC title

• A45D44/00 Primary

  Other cosmetic or toiletry articles, e.g. for hairdressers' rooms · CPC title