Makeup supporting device, makeup supporting system, makeup supporting method, and non-transitory computer-readable recording medium

Patent metadata

Field	Value
Publication number	US-9846803-B2
Application number	US-201514715610-A
Country	US
Kind code	B2
Filing date	May 19, 2015
Priority date	Aug 30, 2013
Publication date	Dec 19, 2017
Grant date	Dec 19, 2017

Abstract

A makeup supporting device includes: a makeup presentation unit that generates a simulation image by superimposing a makeup image on an image obtained by photographing a face, the makeup image indicating a state in which makeup is applied to the face; a makeup correction unit that receives correction of the makeup image included in the generated simulation image from a user; and a correction information recording unit that records correction information which indicates a region of a post-correction makeup image using a relative position to a facial feature points.

First claim

What is claimed is:

1. A makeup supporting device comprising:
a makeup information storage that stores makeup information including a first makeup information item including color information and area information indicating a first area defined by first makeup reference points; and
a processor that, when executing instructions stored in a storage, performs operations comprising:
acquiring facial feature points including first facial feature points from an image obtained by photographing a face;
setting facial reference points to the image based on the facial feature points, the facial reference points including first facial reference points which are set to the image based on the acquired first facial feature points;
generating a simulation image by superimposing a makeup image on the image, the makeup image indicating a state in which makeup is applied to the face;
receiving correction of the makeup image included in the generated simulation image from a user; and
recording correction information which indicates a region of a post-correction makeup image using a relative position to the facial feature points,
wherein the generating comprises:
generating a second area defined by the first facial reference points, such that the second area and the first area have a same relationship as a relationship between the first facial reference points and the first makeup reference points; and
painting the second area with a color indicated by the color information stored in the makeup information storage, to generate the simulation image,
wherein, in the receiving of correction, the user changes an outline of the second area to generate a third area, the third area having the changed outline and having the color, and
wherein the correction information includes information defining the difference between the second area and the third area.

2. The makeup supporting device according to claim 1 , further comprising:
a display that displays the generated simulation image.

3. The makeup supporting device according to claim 2 , wherein the correction information is stored in a recording medium that is useable by a user of a device other than the makeup supporting device.

4. The makeup supporting device according to claim 3 ,
wherein the makeup information indicating a region of a pre-correction makeup image using the relative position to the facial feature points, and
wherein the correction information includes information indicating the region of the pre-correction makeup image and information indicating a difference between the region of the post-correction makeup image and the region of the pre-correction makeup image.

5. The makeup supporting device according to claim 4 , wherein
the correction includes at least one of translation, rotation, scaling, and deformation of the makeup image,
the makeup information includes information indicating the relative position of the region of the pre-correction makeup image to the facial feature points, and
the correction information includes information that indicates the difference between the region of the post-correction makeup image and the region of the pre-correction makeup image using a face coordinate system based on an arrangement of the facial feature points.

6. The makeup supporting device according to claim 5 ,
wherein the makeup information includes information indicating positions of makeup reference points set with respect to the region of the makeup image, the makeup reference points becoming target points which are adjusted to facial reference points set in the image,
the region of the makeup image is determined with respect to the image by adjusting the position of the makeup reference points in the makeup image to the position of the set facial reference points, and
the correction information includes information indicating a difference between the positions of the makeup reference points in the region of the post-correction makeup image and default positions of the facial reference points using the face coordinate system.

7. The makeup supporting device according to claim 6 , further comprising:
a camera that photographs a video image of the face,
wherein the image comprises the video image,
the display sequentially displays the simulation image along the video image, and
the positions of the facial reference points are set according to the correction information after the correction is set.

8. A makeup supporting system comprising:
a first makeup supporting device; and
a second makeup supporting device,
wherein the first makeup supporting device includes:
a makeup information storage that stores makeup information including a first makeup information item including color information and area information indicating a first area defined by first makeup reference points; and
a processor that, when executing instructions stored in a storage, performs operations comprising:
acquiring facial feature points including first facial feature points from a first image obtained by photographing a first face;
setting first facial reference points to the first image based on the acquired first facial feature points;
generating a first simulation image by superimposing a makeup image on the first image, the makeup image indicating a state in which makeup is applied to the first face;
receiving correction of the makeup image included in the generated first simulation image from a user; and
recording correction information which indicates a region of a post-correction makeup image using a relative position to the first facial feature points,

wherein the generating comprises:
generating a second area defined by the first facial reference points, such that the second area and the first area have a same relationship as a relationship between the first facial reference points and the first makeup reference points; and
painting the second area with a color indicated by the color information stored in the makeup information storage, to generate the simulation image,

wherein, in the receiving of correction, the user changes an outline of the second area to generate a third area, the third area having the changed outline and having the color, and
wherein the correction information includes information defining the difference between the second area and the third area, and
wherein the second makeup supporting device includes a processor that, when executing instruction stored in a storage, performs operations comprising:
acquiring the recorded correction information; and
generating a second simulation image by superimposing the post-correction makeup image on a second image obtained by photographing a second face, based on the acquired correction information.

9. A makeup supporting method comprising:
storing, in a makeup information storage, makeup information including a first makeup information item including color information and area information indicating a first area defined by first makeup reference points;
acquiring facial feature points including first facial feature points from an image obtained by photographing a face;
setting first facial reference points to the image based on the acquired first facial feature points;
generating a simulation image by superimposing a makeup image on the image, the makeup image indicating a state in which makeup is applied to the face;
receiving correction of the makeup image included in the generated simulation image from a user; and
recording correction information which indicates a region of a post-correction makeup image using a relative position to the facial feature points
wherein the generating comprises:
generating a second area defined by the first facial reference points, such that the secon

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Yamanashi Tomofumi
• Asai Rieko
• Muta Aoi
• Nishi Chie
• Ajiki Kaori

Classifications

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• A45D44/005 Primary

  for selecting or displaying personal cosmetic colours or hairstyle · CPC title

• G06K9/00268 Primary

  Physics · mapped topic