Electronic device for analyzing skin image and method for controlling the same

Patent metadata

Field	Value
Publication number	US-11869213-B2
Application number	US-202117142878-A
Country	US
Kind code	B2
Filing date	Jan 6, 2021
Priority date	Jan 17, 2020
Publication date	Jan 9, 2024
Grant date	Jan 9, 2024

Abstract

An electronic device including a display; a distance sensor; a camera; and at least one processor configured to: obtain a two-dimensional (2D) face image of a user via the camera and obtain distance sensing data via the distance sensor; identify a distance between the user and the electronic device, and a rotation angle of a face of the user with respect to the electronic device, using the obtained 2D face image and the obtained distance sensing data; modify at least a part of the 2D face image based on at least one of the identified distance and the identified rotation angle; and provide information about at least the part of the modified 2D face image via the display.

First claim

What is claimed is:

1. An electronic device, comprising:
a display;
a distance sensor including a time-of-flight (ToF) sensor, wherein the ToF sensor includes a light source module and a light receiving module, the light source module including a left light source and a right light source;
a camera; and
at least one processor configured to:
obtain a two-dimensional (2D) face image of a user via the camera and obtain distance sensing data via the ToF sensor;
identify a distance between a face of the user and the electronic device, and a rotation angle and a rotation direction of the face of the user with respect to the electronic device, using the obtained 2D face image and the obtained distance sensing data;
modify at least a part of the 2D face image based on the identified distance and the identified rotation angle; and
provide information about at least the part of the modified 2D face image via the display,
wherein the at least one processor is further configured to:
identify sizes of a pore and a wrinkle in the 2D face image, the pore and the wrinkle being included in the 2D face image;
correct the sizes of the pore and the wrinkle, based on a correction coefficient corresponding to the identified distance; and
re-correct the corrected sizes of the pore and the wrinkle, based on the identified rotation angle,

wherein the at least one processor is further configured to:
determine, based on the identified distance, a strength of a light to be outputted by the left light source and the right light source;
based on identifying, by the identified rotation angle and the identified rotation direction, that the face turns right, decrease the determined strength of a light outputted from the left light source and increase the determined strength of a light outputted from the right light source; and
based on identifying, by the identified rotation angle and the identified rotation direction, that the face turns left, decrease the determined strength of the light outputted from the right light source and increase the determined strength of the light outputted from the left light source,

wherein the at least one processor is further configured to:
display, through the display, a guide with a first size corresponding to an average face size;
identify a size of the face, from the obtained 2D face image;
based on the size of the face being different from the average face size, change, based on the identified size of the face, a size of the guide from the first size to a second size different from the first size; and
display, through the display, the guide with the second size.

2. The electronic device of claim 1 , wherein the distance between the face of the user and the electronic device corresponds to a distance between the electronic device and a nose tip of the face of the user.

3. The electronic device of claim 1 , wherein the at least one processor is further configured to:
obtain a three-dimensional (3D) shape of the face of the user using the distance sensing data obtained via the ToF sensor; and
modify a brightness of the obtained 2D face image based on the 3D shape of the face of the user.

4. The electronic device of claim 3 , wherein the at least one processor is further configured to identify a volume of the face of the user based on the 3D shape of the face of the user and provide a predetermined guide based on the identified volume.

5. A method for controlling an electronic device, the method comprising:
obtaining a two-dimensional (2D) face image of a user via a camera of the electronic device;
obtaining distance sensing data via a distance sensor of the electronic device, wherein the distance sensor includes a time-of-flight (ToF) sensor, wherein the ToF sensor includes a light source module and a light receiving module, the light source module including a left light source and a right light source;
identifying a distance between a face of the user and the electronic device, and a rotation angle and a rotation direction of the face of the user with respect to the electronic device, using the obtained 2D face image and the obtained distance sensing data;
modifying at least a part of the 2D face image based on the identified distance and the identified rotation angle; and
providing information about at least the part of the modified 2D face image via a display,
wherein the method further comprises:
identifying sizes of a pore and a wrinkle in the 2D face image, the pore and the wrinkle being included in the 2D face image;
correcting the sizes of the pore and the wrinkle, based on a correction coefficient corresponding to the identified distance; and
re-correcting the corrected sizes of the pore and the wrinkle, based on the identified rotation angle,

wherein the method further comprises:
determining, based on the identified distance, a strength of a light to be outputted by the left light source and the right light source;
based on identifying, by the identified rotation angle and the identified rotation direction, that the face turns right, decreasing the determined strength of a light outputted from the left light source and increasing the determined strength of a light outputted from the right light source; and
based on identifying, by the identified rotation angle and the identified rotation direction, that the face turns left, decreasing the determined strength of the light outputted from the right light source and increasing the determined strength of the light outputted from the left light source,

wherein the method further comprises:
displaying, through the display, a guide with a first size corresponding to an average face size;
identifying a size of the face, from the obtained 2D face image;
based on the size of the face being different from the average face size, changing, based on the identified size of the face, a size of the guide from the first size to a second size different from the first size; and
displaying, through the display, the guide with the second size.

6. The method of claim 5 , wherein the distance between the face of the user and the electronic device corresponds to a distance between the electronic device and a nose tip of the face of the user.

7. The method of claim 5 , further comprising:
obtaining a three-dimensional (3D) shape of the face of the user using the distance sensing data obtained via the ToF sensor; and
modifying a brightness of the obtained 2D face image using the 3D shape of the face of the user.

8. The method of claim 7 , further comprising:
identifying a volume of the face of the user using the 3D shape of the face of the user; and
providing a predetermined guide based on the identified volume.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Choi Hyoungseon
• Oh Youngjae
• Lee Sangkyung
• Jeon Taehan
• Choi Changhwan
• Kim Joonho
• Min Jinhong

Classifications

• G06T7/73 Primary

  using feature-based methods · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06T3/60

  Rotation of whole images or parts thereof · CPC title

• G06T7/50

  Depth or shape recovery · CPC title

• G06T7/62

  of area, perimeter, diameter or volume · CPC title