Oral care based digital imaging systems and methods for determining perceived attractiveness of a facial image portion

Patent metadata

Field	Value
Publication number	US-11978207-B2
Application number	US-202117337503-A
Country	US
Kind code	B2
Filing date	Jun 3, 2021
Priority date	Jun 3, 2021
Publication date	May 7, 2024
Grant date	May 7, 2024

Abstract

Oral care based imaging computer-implemented systems and methods for determining perceived attractiveness of a facial image portion of at least one person depicted in a digital image. The method has the following steps:
a) obtaining a digital image comprising at least one oral feature of at least one person, wherein the digital image includes a facial image portion of the at least one person, the facial image portion having both positive and negative attributes as defined by pixel data of the digital image; b) analyzing the facial image portion; c) generating an Attractiveness Score indicative of a perceived attractiveness of the facial image portion based on the analyzed facial image portion in the obtained digital image; d) further generating an image description that identifies at least one area in said facial image portion based on the Attractiveness Score; and e) presenting the image description to a use.

First claim

What is claimed is:

1. An oral care digital imaging computer-implemented method for determining perceived attractiveness of a facial image portion of at least one person depicted in a digital image, the method comprising the steps of:
a) obtaining the digital image comprising at least one oral feature of the at least one person, wherein the digital image comprises the facial image portion of the at least one person, wherein the facial image portion has both positive and negative attributes as defined by pixel data of the digital image;
b) analyzing the facial image portion;
c) generating an Attractiveness Score indicative of a perceived attractiveness of the facial image portion based on the analyzed facial image portion in the obtained digital image, wherein the Attractiveness Score is generated as a probability value indicative of how appealing the facial image portion of the at least one person depicted in a digital image is to a population of people based on the positive and negative attributes of the facial image portion, wherein the probability value is determined by a model constructed by a machine learning system trained by a training dataset, and wherein the training dataset comprises (i) a plurality of simulated images of a facial image portion comprising simulated positive and negative attributes; and (ii) an associated class definition based on the simulated positive and negative attributes;
d) further generating an image description that identifies at least one area in the facial image portion based on the Attractiveness Score; and
e) presenting the image description to a user.

2. The method of claim 1 , wherein the method comprises presenting the Attractiveness Score to the user after step (c).

3. The method of claim 1 , wherein the image description further indicates an impact of the identified area in the facial image portion on the Attractiveness Score, wherein the image description comprises a consumer relevant description for perceived attractiveness of the facial image portion.

4. The method of claim 1 , wherein the facial image portion comprises facial skin, one or more oral features, one or more facial expressions, or combinations thereof.

5. The method of claim 4 , wherein the facial image portion comprises the one or more oral features, and the one or more oral features comprises oral cavity soft tissue, gum, teeth, or combinations thereof.

6. The method of claim 4 , wherein the facial image portion comprises the one or more facial expressions, and the one or more facial expressions comprises a smile.

7. The method of claim 1 , wherein the facial image portion is defined by a first oral feature and a second oral feature associated with the facial image portion, each of the first oral feature and the second oral feature comprising oral cavity soft tissue, gum, teeth, or combinations thereof.

8. The method according to claim 7 , wherein the first oral feature comprises a first set of characteristics indicative of positive cosmetic dental attributes for the facial image portion, each positive cosmetic dental attribute is assigned a positive value indicative that the first oral feature is healthy; wherein the second oral feature comprises a second set of characteristics indicative of negative cosmetic dental attributes for the facial image portion, wherein the first oral feature and the second oral feature are located in different parts of the at least one area in the facial image portion.

9. The method of claim 1 , wherein the method comprises receiving a request for additional information about the facial image portion, wherein the additional information comprises providing information related to improvement of the Attractiveness Score.

10. The method of claim 1 , wherein analyzing in step (b) comprises filtering the facial image portion to obtain one or more filtered feature maps comprising a first feature of interest and a second feature of interest, each of the first and second features of interest is associated with the facial image portion, wherein the first feature of interest comprises a first set of characteristics indicative of positive attributes for the facial image portion, and the second feature of interest comprises a second set of characteristics indicative of negative attributes for the facial image portion, and wherein the first feature of interest and the second feature of interest are located in different parts of the at least one area in the facial image portion.

11. The method of claim 1 , wherein presenting the image description comprises displaying the image description in the digital image as alternative text, displaying the image description in the digital image as a heat map, providing the image description for audible presentation to the user, or combinations thereof.

12. The method of claim 11 , wherein presenting the image description comprises displaying the image description in the digital image as the heat map, and displaying the image description in the digital image as the heat map comprises generating the heat map.

13. The method of claim 12 , wherein generating the heat map comprises overlaying a layer on at least a portion of the digital image comprising the facial image portion.

14. The method of claim 13 , wherein the layer is a pixel map that identifies the at least one area comprising at least one of the analyzed positive and/or negative attributes.

15. A method for presenting a product recommendation for improving perceived attractiveness of a facial image portion, the method comprising:
transmitting the digital image of claim 1 ;
receiving an image presentation that identifies at least one area in the facial image portion comprising at least one of the negative attributes analyzed using the method of claim 1 ; and
presenting a product recommendation for improving perceived attractiveness of the at least one of the analyzed positive and/or negative attributes.

16. A method of demonstrating efficacy of a customized oral care regimen in improving perceived attractiveness of one or more oral features of at least one person depicted in a digital image, the method comprising:
obtaining a digital image of the at least one person, wherein the digital image comprises the one or more oral features of the at least one person, wherein the one or more oral features has both positive and negative attributes and wherein the one or more oral features is treated with a customized oral care regimen; and
determining perceived attractiveness of the one or more oral features using the method of claim 1 .

17. A method for demonstrating efficacy of a consumer product in improving perceived attractiveness of a facial image portion of at least one person depicted in a digital image, the method comprising:
i) determining perceived attractiveness of a facial image portion of a person in a first digital image using the method of claim 1 , wherein the facial image portion in the first digital image is untreated;
ii) obtaining a second digital image of the person depicted in the first digital image, wherein the second digital image comprises the facial image portion of the person, wherein the facial image portion in the second digital image is treated with a consumer product for a treatment period;
iii) further determining perceived attractiveness of the facial image portion in the second digital image using the method of claim 1 ; and
iv) comparing perceived attractiveness of the facial image portion in the second digital image with perceived attractiveness of the facial image portion in the first digital image.

18.

Assignees

• Procter & Gamble

Inventors

• Tavanei Amirhossein
• Barker Matthew Lloyd
• Sherman Faiz Feisal
• Kinderdine Sherrie Lee
• Hayes Scott Alan
• Hengehold David Anthony
• He Yanyan
• Ouyang Yumeng
• Li Jiahui
• Gurich Nataliya
• Qi Ming

Classifications

• G06T7/0014 Primary

  using an image reference approach · CPC title

• G06Q10/083

  Shipping · CPC title

• G06Q30/0631 Primary

  Recommending goods or services · CPC title

• G06V40/166

  using acquisition arrangements · CPC title

• G06V40/171

  Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships · CPC title