Makeup application assistance device, makeup application assistance method, and makeup application assistance program

Patent metadata

Field	Value
Publication number	US-9615647-B2
Application number	US-201414388923-A
Country	US
Kind code	B2
Filing date	Jan 20, 2014
Priority date	Feb 1, 2013
Publication date	Apr 11, 2017
Grant date	Apr 11, 2017

Abstract

A makeup application assistance device includes: an image acquisition unit that acquires an image obtained by photographing a face; a face part acquisition unit that acquires, from the image, face part regions of the face; a face makeup technique selection unit that selects a face makeup technique, which is a face makeup application method, for each face part; a skin condition acquisition unit that acquires the skin condition of the face; a skin correction makeup technique selection unit that selects, on the basis of the skin condition, a skin correction makeup technique, which is a skin correction makeup application method; and a makeup technique presentation unit that presents the selected face makeup techniques associated with the corresponding face part regions, and presents the selected skin correction makeup technique, to a user.

First claim

The invention claimed is:

1. A makeup assisting apparatus comprising a processor, that executes instructions stored in a memory and is configured to:
acquire a captured image of a face;
determine areas of facial parts from the captured image, each of the areas of the facial parts being defined by feature points constituting the facial part;
select facial makeup for each of the facial parts, the facial makeup being a way of applying facial makeup on corresponding one of the facial parts;
acquire a skin condition for each of divided facial areas into which an area of the face is divided, the divided facial areas being different from the facial parts, the divided facial areas being formed by connecting each of feature points with an adjacent one of the feature points, and determine whether or not skin correction is required for each of the divided facial areas based on the acquired skin condition of each divided facial area;
select, for at least one of the divided facial areas, for which it is determined that the skin correction is required, skin correction makeup based on a skin condition for the at least one of the divided facial areas, the skin correction makeup being a way of applying skin correction makeup on corresponding one of the divided facial areas, the divided facial areas being different from the facial parts,
generate a simulation image based on the determined areas of the facial parts, the selected facial makeup for each of the facial parts and the selected skin correction makeup for the at least one of the divided facial areas, the simulation image being obtained by superimposing, on the captured image, an image indicating the selected facial makeup for each of the facial parts and the selected skin correction makeup for the at least one of the divided facial areas when the selected facial makeup and the selected skin correction makeup are applied to the face; and
display the simulation image.

2. The makeup assisting apparatus according to claim 1 , wherein the processor is further configured to:
present the skin correction makeup in association with a corresponding one of the divided facial areas.

3. The makeup assisting apparatus according to claim 1 , wherein
the processor determines whether the skin correction is required, when a skin condition for corresponding one of the divided facial areas reaches a predetermined level; and
wherein the processor is further configured to set the at least one of the divided facial areas where skin correction is required as a selection target for the skin correction makeup.

4. The makeup assisting apparatus according to claim 3 , wherein the processor is further configured to:
capture a moving image of the face of a user;
acquire images included in the moving image;
sequentially generate simulation images for the respective images included in the moving image while keeping the facial makeup and the skin correction makeup selected once for the moving image, and sequentially display the simulation images.

5. The makeup assisting apparatus according to claim 1 , wherein the processor is further configured to:
acquire a partial feature value of the face;
select the facial makeup with reference to a facial makeup table in which the partial feature values to be acquired and the facial makeup are registered in advance in association with each other;
acquire a skin feature value for each of the divided facial areas; and
select the skin correction makeup with reference to a skin correction makeup table in which the skin feature values to be acquired and skin correction makeup are registered in advance in association with each other.

6. The makeup assisting apparatus according to claim 1 , wherein the skin condition includes at least one of spot (macule), wrinkle, dullness, shadow, pore, moisture, oil, texture, and ruddiness conditions.

7. The makeup assisting apparatus according to claim 1 , wherein:
the facial makeup and the skin correction makeup include at least a color, application concentration and application range of a skin cosmetic agent; and
the processor is further configured to present information regarding cosmetics required for applying the selected facial makeup and the skin correction makeup.

8. The makeup assisting apparatus according to claim 1 , wherein the facial makeup is selected independent of the skin condition.

9. A makeup assisting method comprising:
acquiring a captured image of a face;
determining areas of facial parts from the captured image, each of the areas of the facial parts being defined by feature points constituting the facial part;
selecting facial makeup for each of the facial parts, the facial makeup being a way of applying facial makeup on corresponding one of the facial parts;
acquiring a skin condition for each of divided facial areas into which an area of the face is divided, the divided facial areas being different from the facial parts, the divided facial areas being formed by connecting each of feature points with an adjacent one of the feature points, and determine whether or not skin correction is required for each of the divided facial areas based on the acquired skin condition of each divided facial area;
selecting, for at least one of the divided facial areas, for which is it determined that the skin correction is required, skin correction makeup based on a skin condition for the at least one of the divided facial areas, the skin correction makeup being a way of applying skin correction makeup on corresponding one of the divided facial areas, the divided facial areas being different from the facial parts; and
generating a simulation image based on the determined areas of the facial parts, the selected facial makeup for each of the facial parts and the selected skin correction makeup for the at least one of the divided facial areas, the simulation image being obtained by superimposing, on the captured image, an image indicating the selected facial makeup for each of the facial parts and the selected skin correction makeup for the at least one of the divided facial areas when the selected facial makeup and the selected skin correction makeup are applied to the face; and
displaying the generated simulation image.

10. A non-transitory computer-readable storage medium with an executable computer program that causes a computer processor to execute processing, comprising:
acquiring a captured image of a face;
determining areas of facial parts from the captured image, each of the areas of the facial parts being defined by feature points constituting the facial part;
selecting facial makeup for each of the facial parts, the facial makeup being a way of applying facial makeup on corresponding one of the facial parts;
acquiring a skin condition for each of divided facial areas into which an area of the face is divided, the divided facial areas being different from the facial parts, the divided facial areas being formed by connecting each of feature points with an adjacent one of the feature points, and determine whether or not skin correction is required for each of the divided facial areas based on the acquired skin condition of each divided facial area;
selecting, for at least one of the divided facial areas, for which it is determined that the skin correction is required, skin correction makeup based on a skin condition for the at least one of the divided facial areas, the skin correction makeup being a way of applying skin correction makeup on corresponding one of the divided facial areas, the divided facial areas being different from the facial parts;
generating a simulation image based on the determined areas of the facial parts, the selected facial makeup for each of the facial parts and the se

Assignees

• Panasonic Corp
• Panasonic Ip Man Co Ltd

Inventors

• Yamanashi Tomofumi
• Asai Rieko
• Muta Aoi
• Nishi Chie
• Ajiki Kaori

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• A45D44/005 Primary

  for selecting or displaying personal cosmetic colours or hairstyle · CPC title

• A45D2044/007

  Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2207/10004

  Still image; Photographic image · CPC title