Makeup application assistance device, makeup application assistance method, and makeup application assistance program

Patent metadata

Field	Value
Publication number	US-9812030-B2
Application number	US-201414389018-A
Country	US
Kind code	B2
Filing date	Jan 22, 2014
Priority date	Feb 1, 2013
Publication date	Nov 7, 2017
Grant date	Nov 7, 2017

Abstract

To appropriately assist with the application of makeup involving referencing a makeup technique of another person, this makeup application assistance device includes: first face part acquisition unit that acquires face part regions of a first face from a first image obtained by capturing the first face; second face part acquisition unit that acquires face part regions of a second face to which makeup has been applied, from a second image obtained by capturing the second face; reference makeup technique acquisition unit that acquires, for each face part of the second face, a makeup technique, which is a makeup application method, from the second image on the basis of the face part regions of the second face; and makeup technique presentation unit that associates the acquired makeup techniques with the corresponding face part regions of the first face, and presents the makeup techniques to a user.

First claim

The invention claimed is:

1. A make-up assisting apparatus that provides assistance for make-up using make-up used by others as a reference, the make-up assisting apparatus comprising a processor that, when executing instructions stored in a memory, performs operations comprising:
acquiring a first image, which is a captured image of a user face;
acquiring areas of facial parts of the user face from the first image;
acquiring a second image, which is a captured image of a model face to which make-up has been applied;
acquiring areas of facial parts of the model face from the second image;
specifying an area having a color approximate to a color of the skin of the model face, from positions of the acquired areas of the facial parts of the model face;
acquiring, from the second image, make-up for each facial part of the facial parts of the model face, based on a difference between the color of the specified area of the second image and an actual color of the facial part of the second image, the make-up including a way of applying the make-up; and
generating a simulation image obtained by superimposing, on the first image, an image indicating a state of the make-up when the make-up acquired from the second image is applied to the user face, and displaying the generated simulation image.

2. The make-up assisting apparatus according to claim 1 , wherein:
the make-up includes at least a color, application concentration and an application range of a skin cosmetic agent; and
the processor, when executing instructions stored in the memory, further performs operations of acquiring at least the application range of the make-up based on the area of the facial part of the model face.

3. The make-up assisting apparatus according to claim 1 , wherein the processor further performs:
generating, when make-up has been applied to the user face included in the first image, a make-up removed image from the first image, the make-up removed image being an image of the user face in which no make-up is applied; and
generating a simulation image obtained by superimposing, on the make-up removed image, an image indicating a state of the make-up when the make-up acquired from the second image is applied to the user face, and displaying the generated simulation image.

4. The make-up assisting apparatus according to claim 1 , wherein the processor further performs operations of presenting information relating to a cosmetic required for applying the make-up acquired from the second image on the user face.

5. A make-up assisting method that provides assistance for make-up using make-up used by others as a reference, the make-up assisting method comprising:
acquiring a first image, which is a captured image of a user face;
acquiring areas of facial parts of the user face from the first image;
acquiring a second image, which is a captured image of a model face to which make-up has been applied;
acquiring areas of facial parts of the model face from the second image;
specifying an area having a color approximate to a color of the skin of the model face, from positions of the acquired areas of the facial parts of the model face;
acquiring, from the second image, make-up for each facial part of the facial parts of the model face, based on a difference between the color of the specified area of the second image and an actual color of the facial part of the second image, the make-up including a way of applying the make-up; and
generating a simulation image obtained by superimposing, on the first image, an image indicating a state of the make-up when the make-up acquired from the second image is applied to the user face, and displaying the generated simulation image.

6. A non-transitory computer-readable storage medium comprising a make-up assisting program that provides assistance for make-up using make-up used by others as a reference, the make-up assisting program causing a computer to execute processing comprising:
acquiring, a first image which is a captured image of a user face;
acquiring areas of facial parts of the user face from the first image;
acquiring, a second image which is a captured image of a model face to which make-up has been applied;
acquiring areas of facial parts of the model face from the second image;
specifying an area having a color approximate to a color of the skin of the model face, from positions of the acquired areas of the facial parts of the model face;
acquiring, from the second image, make-up for each facial part of the facial parts of the model face based on a difference between the color of the specified area of the second image and an actual color of the facial part of the second image, the make-up including a way of applying the make-up; and
generating a simulation image obtained by superimposing, on the first image, an image indicating a state of the make-up when the make-up acquired from the second image is applied to the user face, and displaying the generated simulation image.

7. The make-up assisting apparatus according to claim 1 , wherein the area having the color approximate to the color of the skin of the model face includes an ear or a neck of the model face in the second image.

Assignees

• Panasonic Corp
• Panasonic Ip Man Co Ltd

Inventors

• Yamanashi Tomofumi
• Asai Rieko
• Muta Aoi
• Nishi Chie
• Ajiki Kaori

Classifications

• A45D44/005

  for selecting or displaying personal cosmetic colours or hairstyle · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• A45D44/00 Primary

  Other cosmetic or toiletry articles, e.g. for hairdressers' rooms · CPC title

• G06F40/134

  Hyperlinking · CPC title

• G09B5/02

  with visual presentation of the material to be studied, e.g. using film strip · CPC title