Makeup assistance device, makeup assistance method, and makeup assistance program

Patent metadata

Field	Value
Publication number	US-10660425-B2
Application number	US-201414770167-A
Country	US
Kind code	B2
Filing date	Feb 4, 2014
Priority date	Feb 28, 2013
Publication date	May 26, 2020
Grant date	May 26, 2020

Abstract

Provided is a makeup assistance device that can assist in makeup/skin treatment more appropriately. This makeup assistance device comprises: a physical condition acquisition unit ( 260 ) that acquires physical condition information related to the physical condition of a person performing makeup and/or skin treatment; a makeup/skincare selection unit ( 280 ) that selects a makeup, which is how to apply makeup, and/or a skincare, which is how to treat the skin, on the basis of the acquired physical condition information; and a makeup/skincare presentation unit ( 290 ) that presents the selected makeup and/or skincare to the user performing makeup/skin treatment.

First claim

The invention claimed is:

1. A makeup assisting apparatus that presents makeup and/or skin care depending on a physical condition of a person subjected to makeup and/or skin maintenance, the apparatus comprising:
a display;
a camera that captures an image of a face of a person;
at least one sensor including at least one of a sleep meter, a thermometer or a physical activity meter that numerically measure sleeping hours, a body temperature and an amount of physical activity;
a processor and a memory,
wherein the memory stores a physical condition table and a makeup/skin care table,
the physical condition table describes correspondence relationships between a plurality of contents of sensor information and physical condition levels, the physical condition levels being values indicating quality levels of human physical conditions,
the makeup/skin care table describes, in association with one another:
the physical condition levels and makeup and/or skin care suitable for an estimated change in a facial condition of the person after a lapse of a predetermined period of time,

wherein the processor is configured to:
acquire the captured image of the face of the person;
communicably connect to the at least one sensor, and acquire at least one parameter as the sensor information, the at least one parameter including at least one of the sleeping hours, the body temperature, or the amount of physical activity measured by the sleep meter, the thermometer and the physical activity meter;
determine a physical condition level of the person corresponding to the acquired sensor information by referring to the physical condition table;
select makeup and/or skin care associated with the determined physical condition level of the person by referring to the makeup/skin care table; and
create a simulation image by superimposing, on the captured image, an image indicating the selected makeup and/or the selected skin care in a state where the selected makeup and/or the selected skin care are/is applied to the face, and display, on the display, the created simulation image,

wherein the makeup/skin care table stored in the memory further includes facial feature value groups, each being in association with the makeup and/or the skin care and the physical condition levels,
the processor is further configured to:
acquire a facial feature value of the face of the person by analyzing the captured image of the face of the person, the facial feature value being multivariate data including a plurality of values indicating features of the face of the person,
determine a facial feature value group of the acquired facial feature value, by determining a distance between the acquired facial feature value and a representative value of each of the facial feature value groups, and
select the makeup and/or the skin care associated with the determined facial feature value group and the determined physical condition level of the person by referring to the makeup/skin care table,
wherein, the processor
acquires images in a moving image captured by the camera, and
sequentially creates simulation images for the respective images included in the moving image while keeping the selected make-up and/or the selected skin care for the moving image, and sequentially displays, on the display, the sequentially created simulation images,
wherein the makeup assisting apparatus further comprises
a printer that transfers a cosmetic agent of skin cosmetics corresponding to the selected makeup and/or the selected skin care to an area of a thin film corresponding to the selected makeup and/or the selected skin care, such that the thin film holds the cosmetic agent to be easily peeled off and transferred to a skin of the person when the thin film is pressed against the skin of the person.

2. The makeup assisting apparatus according to claim 1 wherein the processor is further configured to:
acquire areas of facial parts of the face from the captured image;
select the make-up and/or the skin care for each of the facial parts, and
create the simulation image by superimposing, on the captured image, the image indicating the selected makeup and/or the selected skin care in a state where the selected make-up and/or the selected skin care are/is applied to the face, based upon the selected make-up and/or the skin care for each of the facial parts.

3. The makeup assisting apparatus according to claim 1 , wherein the change in the facial condition includes change in a degree of at least one of dryness of skin, secretion of sebum, secretion of sweat, dark circle, wrinkles, skin slackness, muscle relaxation, muscle excitation, poorness of complexion, and rough skin.

4. The makeup assisting apparatus according to claim 1 , wherein:
the physical condition table describes at least the correspondence relationships between the sleeping hours and the body temperature and the physical condition levels,
the sensor includes at least the sleep meter and the thermometer, and
the processor determines the physical condition level of the person corresponding to the sleeping hour acquired by the sleep meter and the body temperature acquired by the thermometer.

5. The makeup assisting apparatus according to claim 1 , wherein
the processor superimposes the image indicating the selected makeup and/or the selected skin care on the captured image, by using an alpha blending process, which is defined by the following equations:
R=r 2 ×α+r 1 ×(1−α),

G=g 2 ×α+g 1 ×(1−α),

B=b 2 ×α+b 1 ×(1−α),

where r 1 , g 1 and b 1 are the RGB values of an area in the captured image, r 2 , g 2 and b 2 are the RGB values of the corresponding area in the image indicating the selected makeup and/or the selected skin care, R, G and B are RGB values of the corresponding area in the simulation image, and α is a value set according to concentration of the selected makeup.

6. A makeup assisting method for a makeup assisting device including a memory, a processor, a display and a printer, and is connectable to a camera and at least one sensor including at least one of a sleep meter, a thermometer or a physical activity meter that numerically measure sleeping hours, a body temperature, and an amount of physical activity, the makeup assisting method presenting makeup and/or skin care depending on a physical condition of a person subjected to makeup and/or skin maintenance, the method comprising:
acquiring an image of a face of the person captured by the camera;
communicably connecting to the at least one sensor, and acquiring at least one parameter as sensor information, the at least one parameter including at least one of the sleeping hours, the body temperature, or the amount of physical activity measured by the sleep meter, the thermometer and the physical activity meter;
determining a physical condition level of the person corresponding to the acquired sensor information, by referring to a physical condition table, the physical condition table being stored in a memory and describing correspondence relationships between a plurality of contents of sensor information and physical condition levels, the physical condition levels being values indicating quality levels of human physical conditions;
selecting makeup and/or skin care associated with the determined physical condition level of the person, by referring to a makeup/skin care table, the makeup/skin care table being stored in the memory and describing, in association with one another:
the physical condition levels and makeup and/or skin care suitable for an estimated change in a facial condition of the person after a lapse of a predetermined period of time; and

creating a simulation image by superimposing, on the captured image, an image indicating the selected makeup and/or t

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Yamanashi Tomofumi
• Asai Rieko
• Muta Aoi
• Nishi Chie
• Ajiki Kaori

Classifications

• A61B5/4806

  Sleep evaluation (A61B5/4821 takes precedence; devices for inducing sleep A61M21/02) · CPC title

• A61B5/1118

  Determining activity level · CPC title

• A61B5/4318

  Evaluation of the lower reproductive system (A61B5/4343 takes precedence) · CPC title

• A45D2044/007

  Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment · CPC title

• G06T1/0007

  Image acquisition · CPC title