Electronic device for identifying sunscreen applied to a user's skin and method of operating the same

Patent metadata

Field	Value
Publication number	US-12136245-B2
Application number	US-202217736369-A
Country	US
Kind code	B2
Filing date	May 4, 2022
Priority date	May 28, 2021
Publication date	Nov 5, 2024
Grant date	Nov 5, 2024

Abstract

An electronic device includes a camera, a light source unit, a display, and a processor, wherein the processor is configured to obtain a first image of a skin of a user by the camera while a first light is output through the light source unit, obtain a second image of the skin of the user by the camera while the first light is not output through the light source unit, obtain a third image representing a difference between the first image and the second image by converting, into a first difference pixel value, a difference between first brightness values of the first image and second brightness values of the second image, and display, on the display, information on an ultraviolet (UV) protection ingredient applied to the skin of the user, based on the third image.

First claim

The invention claimed is:

1. An electronic device comprising:
a camera;
a light source unit;
a display; and
a processor; and
a memory storing instructions, that, when executed by the processor, cause the electronic device to:
obtain a first image of a skin of a user by the camera while a first light is output through the light source unit,
obtain a second image of the skin of the user by the camera while the first light is not output through the light source unit,

compare the first image and the second image by calculating a difference between first brightness values of the first image and second brightness values of the second image,
obtain a third image representing a difference between the first image and the second image by converting, into a first difference pixel value, the difference between the first brightness values of the first image and the second brightness values of the second image, and
display, on the display, information on an ultraviolet (UV) protection ingredient applied to the skin of the user, based on the third image,

wherein the conversion of the difference between first brightness values of the first image and second brightness values of the second image into the first difference pixel value is based on a relation formula between a brightness value and a pixel value.

2. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
identify a type of the UV protection ingredient included in a cosmetic product of the user, and
determine whether to output the first light, based on a result of the identification.

3. The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to:
obtain a fourth image for the cosmetic product by the camera, and
identify the type of the UV protection ingredient included in the cosmetic product based on a comparison between the fourth image and pre-stored data.

4. The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to:
based on the UV protection ingredient comprising a reflective UV protection ingredient, output a second light different from the first light through the light source unit,
while the second light is output, obtain a fifth image for the skin of the user through the camera, and
display, on the display, the information on the UV protection ingredient applied to the skin of the user, based on the fifth image.

5. The electronic device of claim 4 , wherein the first light comprises UV light, and
wherein the second light comprises visible light.

6. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
display, on the display, a sixth image visualized through a conversion of a color space of the third image.

7. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
display, on the display, a seventh image visualized through application of a contrast characteristic of the third image to the second image.

8. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
convert first pixel values of the first image into the first brightness values, and
convert second pixel values of the second image into the second brightness values.

9. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
identify the first brightness values of the first image, and
identify the second brightness values of the second image.

10. An operation method of an electronic device, the method comprising:
obtaining a first image of a skin of a user through a camera included in the electronic device while a first light is output through a light source unit included in the electronic device;
obtaining a second image of the skin of the user through the camera while the first light is not output through the light source unit;
comparing the first image and the second image by calculating a difference between first brightness values of the first image and second brightness values of the second image;
obtaining a third image representing a difference between the first image and the second image by converting, into a first difference pixel value, the difference between the first brightness values of the first image and the second brightness values of the second image; and
displaying, on a display included in the electronic device, information on an ultraviolet (UV) protection ingredient applied to the skin of the user, based on the third image,
wherein the converting the difference between first brightness values of the first image and second brightness values of the second image into the first difference pixel value is based on a relation formula between a brightness value and a pixel value.

11. The operation method of claim 10 , further comprising:
identifying a type of the UV protection ingredient included in a cosmetic product of the user; and
determining whether to output the first light, based on a result of the identification.

12. The operation method of claim 11 , wherein the identifying of the type of the UV protection ingredient comprises:
obtaining a fourth image for the cosmetic product through the camera; and
identifying the type of the UV protection ingredient included in the cosmetic product through a comparison between the fourth image and pre-stored data.

13. The operation method of claim 11 , further comprising:
based on the UV protection ingredient comprising a reflective UV protection ingredient, outputting a second light different from the first light through the light source unit;
while the second light is output, obtaining a fifth image for the skin of the user through the camera; and
displaying, on the display, the information on the UV protection ingredient applied to the skin of the user, based on the fifth image.

14. The operation method of claim 13 , wherein the first light comprises UV light, and
wherein the second light comprises visible light.

15. The operation method of claim 10 , wherein the displaying of the information on the UV protection ingredient applied to the skin of the user comprises displaying, on the display, a sixth image visualized through a conversion of a color space of the third image.

16. The operation method of claim 10 , wherein the displaying of information on an ultraviolet (UV) protection ingredient applied to the skin of the user comprises displaying, on the display, a seventh image visualized through application of a contrast characteristic of the third image to the second image.

17. The operation method of claim 10 , wherein the obtaining of the third image comprises converting first pixel values of the first image into first brightness values and converting second pixel values of the second image into second brightness values.

18. An electronic device comprising:
a camera;
a display; and
a processor; and
a memory storing instructions, that, when executed by the processor, cause the electronic device to:
transmit a first control command to an external electronic device including at least one light source element so as to enable the external electronic device to output first light,
obtain a first image of a skin of user by the camera while the first light is output,
transmit a second control command to the external electronic device so as to enable

Assignees

• Samsung Electronics Co Ltd

Inventors

• Choi Hyoungseon
• Oh Youngjae
• Jung Jiwoon
• Kim Joonho

Classifications

• H04N23/56

  provided with illuminating means · CPC title

• G06V10/761

  Proximity, similarity or dissimilarity measures · CPC title

• G06V10/751

  Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching · CPC title

• H04M1/21

  Combinations with auxiliary equipment, e.g. with clocks or memoranda pads · CPC title

• G06V40/10

  Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands · CPC title