Oral care based digital imaging systems and methods for analyzing attributes of a facial image portion

Patent metadata

Field	Value
Publication number	US-12340510-B2
Application number	US-202318529554-A
Country	US
Kind code	B2
Filing date	Dec 5, 2023
Priority date	Jun 4, 2020
Publication date	Jun 24, 2025
Grant date	Jun 24, 2025

Abstract

Oral care based imaging computer-implemented systems and methods for analyzing attributes of a facial image portion of at least one person depicted in a digital image. An oral care digital imaging computer-implemented method for analyzing a facial image portion of a person depicted in a digital image may include analyzing the facial image portion for positive and negative attributes as defined by pixel data of the digital image and generating a probability value based on the positive and negative attributes in the facial image portion in the digital image.

First claim

What is claimed is:

1. An oral care digital imaging computer-implemented method for analyzing a facial image portion of a person depicted in a digital image, the method comprising the steps of:
a) obtaining a digital image comprising the facial image portion of the person;
b) analyzing the facial image portion for positive and negative attributes as defined by pixel data of the digital image;
c) generating a probability value based on the positive and negative attributes in the facial image portion in the digital image, wherein the probability value is determined by a model constructed by a machine learning system trained by a training dataset, and wherein the training dataset comprises (i) a plurality of simulated images of a facial image portion comprising more than one attribute; and (ii) an associated class definition based on the more than one attribute;
d) further generating an image description that identifies an area in the facial image portion based on the probability value; and
e) presenting the image description to a user.

2. The method of claim 1 , wherein the method comprises presenting the probability value to the user after step (c).

3. The method of claim 1 , wherein the image description further indicates the impact of the identified area in the facial image portion on the probability value, wherein the image description comprises a consumer relevant description for perceived attractiveness of the facial image portion.

4. The method of claim 1 , wherein the facial image portion comprises facial skin, one or more oral features, one or more facial expressions, of combinations thereof.

5. The method of claim 4 , wherein the one or more oral features comprises oral cavity soft tissue, gum, teeth, or combinations thereof.

6. The method of claim 4 , wherein the one or more facial expressions comprises a smile.

7. The method of claim 1 , wherein the facial image portion is defined by a first oral feature and a second oral feature associated with the facial image portion, each of the first and second oral features comprising oral cavity soft tissue, gum, teeth, or combinations thereof.

8. The method of claim 7 , wherein the first oral feature comprises a first set of characteristics indicative of positive cosmetic dental attributes for the facial image portion, each positive cosmetic dental attribute is assigned a positive value indicative that the first oral feature is healthy; wherein the second oral feature comprises a second set of characteristics indicative of negative cosmetic dental attributes for the facial image portion, wherein the first oral feature and the second oral feature are located in different parts of the at least one area in the facial image portion.

9. The method of claim 1 , wherein the method comprises receiving a request for additional information about the facial image portion, wherein the additional information comprises providing information related to improvement of the probability value.

10. The method of claim 1 , wherein analyzing in step (b) comprises filtering the facial image portion to obtain one or more filtered feature maps comprising a first feature of interest and a second feature of interest, each of the first and second features of interest is associated with the facial image portion, wherein the first feature of interest comprises a first set of characteristics indicative of positive attributes for the facial image portion, and the second feature of interest comprises a second set of characteristics indicative of negative attributes for the facial image portion, and wherein the first feature of interest and the second feature of interest are located in different parts of the at least one area in the facial image portion.

11. The method of claim 1 , wherein presenting the image description comprises displaying the image description in the digital image as alternative text, displaying the image description in the digital image as a heat map, providing the image description for audible presentation to the user, or combinations thereof.

12. The method of claim 11 , wherein presenting the image description comprises displaying the image description in the digital image as the heat map, and wherein displaying the image description in the digital image as a heat map comprises generating the heat map.

13. The method of claim 12 , wherein generating the heat map comprises overlaying a layer on at least a portion of the digital image comprising the facial image portion.

14. The method of claim 13 , wherein the layer is a pixel map that identifies the at least one area comprising at least one of the analyzed positive and/or negative attributes.

15. A method for presenting a product recommendation for improving perceived attractiveness of a facial image portion, the method comprising:
transmitting a digital image of at least one person, wherein the digital image comprises a facial image portion of the at least one person, wherein the facial image portion has both positive and negative attributes;
receiving an image presentation that identifies at least one area in the facial image portion comprising at least one of the negative attributes analyzed using the method of claim 1 ; and
presenting a product recommendation for improving perceived attractiveness of the at least one of the analyzed positive and/or negative attributes.

16. A method of demonstrating efficacy of a customized oral care regimen in improving perceived attractiveness of one or more oral features of at least one person depicted in a digital image, the method comprising:
obtaining a digital image of the at least one person, wherein the digital image comprises the one or more oral features of the at least one person, wherein the one or more oral features has both positive and negative attributes; wherein one or more oral features is treated with a customized oral care regimen; and
determining perceived attractiveness of the one or more oral features using the method of claim 1 .

17. A method for demonstrating efficacy of a consumer product in improving perceived attractiveness of a facial image portion of at least one person depicted in a digital image, the method comprising:
i) determining perceived attractiveness of a facial image portion of a person in a first digital image using the method of claim 1 ; wherein the facial image portion in the first digital image is untreated;
ii) obtaining a second digital image of the person depicted in the first digital image, wherein the second digital image comprises the facial image portion of the person, wherein the facial image portion in the second digital image is treated with a consumer product for a treatment period;
iii) further determining perceived attractiveness of the facial image portion in the second digital image using the method of claim 1 ; and
iv) comparing perceived attractiveness of the facial image portion in the second digital image with perceived attractiveness of the facial image portion in the first digital image.

18. The method of claim 17 , further comprising treating the facial image portion in the first digital image with a comparative consumer product after step (i) and prior to step (ii) based on the treatment period of step (ii) wherein the treatment period is from two minutes to ten minutes.

19. The method of claim 17 , further comprising repeating step (iii) and step (iv) over a period of time for tracking improvement in the perceived attractiveness of the facial image portion, wherein the period of time is from one day to fourteen days.

Assignees

• Procter & Gamble

Inventors

• Tavanaei Amirhossein
• Barker Matthew Lloyd
• Sherman Faiz Feisal
• Kinderdine Sherrie Lee
• Hayes Scott Alan
• Hengehold David Anthony
• He Yanyan
• Ouyang Yumeng
• Li Jiahui
• Gurich Nataliya
• Qi Ming

Classifications

• G06V40/175

  Static expression · CPC title

• G06V40/171

  Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships · CPC title

• G06V40/166

  using acquisition arrangements · CPC title

• G16H50/20

  for computer-aided diagnosis, e.g. based on medical expert systems · CPC title

• G06T2207/30036

  Dental; Teeth · CPC title