Apparatuses and methods for color matching and recommendations

Patent metadata

Field	Value
Publication number	US-12468966-B2
Application number	US-202418642101-A
Country	US
Kind code	B2
Filing date	Apr 22, 2024
Priority date	Aug 27, 2020
Publication date	Nov 11, 2025
Grant date	Nov 11, 2025

Abstract

An image or a spectrum of a surface may be acquired by a computing device, which may be included in a mobile device in some examples. The computing device may extract a measured spectrum from the image and generate a corrected spectrum of the surface. In some examples, the corrected spectrum may be generated to compensate for ambient light influence. The corrected spectrum may be analyzed to provide a result, such as a diagnosis or a product recommendation. In some examples, the result is based, at least in part, on a comparison of the corrected spectrum to reference spectra. In some examples, the result is based, at least in part, on an inference of a machine learning model.

First claim

What is claimed is:

1 . A method comprising:
acquiring an image of a surface irradiated with a light source of a mobile device; acquiring a measured spectrum of the surface with a spectrometer of the mobile device; analyzing the measured spectrum to reduce an influence of ambient light from the measured spectrum and generating a corrected spectrum, wherein generating the corrected spectrum comprises subtracting the influence of ambient light and an influence of the light source from the measured spectrum; generating an averaged corrected spectrum using the corrected spectrum and at least one other corrected spectrum associated with the surface; generating a result based on a comparison of the averaged corrected spectrum and a database of reference spectra; and providing at least one of a product recommendation or a diagnosis based, at least in part, on the result.

2 . The method of claim 1 , further comprising displaying the image of the surface and at least one of the product recommendation or the diagnosis.

3 . The method of claim 1 , further comprising prompting a user to provide user feedback about the product recommendation or the diagnosis.

4 . The method of claim 3 , further comprising implementing a machine learning model to provide the product recommendation or the diagnosis and updating the machine learning model with the user feedback.

5 . The method of claim 1 , further comprising estimating a specular reflectance based, at least in part, on a measured reflected beam of intensity and an unpolarized light of intensity.

6 . The method of claim 5 , wherein providing the at least one of the product recommendation or the diagnosis is based, at least in part, on the estimated specular reflectance.

7 . A method comprising:
illuminating a surface using a light source of a mobile device; obtaining, at the mobile device, a spectrum of signals reflected from the surface; generating an averaged spectrum using the obtained spectrum and at least one other spectrum associated with the surface; accessing, with the mobile device, stored representations of candidate product samples; selecting at least one of the candidate product samples as a match to a color of the surface based on a comparison between the averaged spectrum and the stored representations; incorporating a user's feedback of the selected one of the candidate product samples in future selections, wherein the user's feedback is ranked based on a level of satisfaction with the selected one of the product and classified based on one or more factors included in the user's feedback for future selections.

8 . The method of claim 7 , wherein the candidate product samples comprise makeup foundation and the surface being skin.

9 . The method of claim 7 , wherein the candidate product samples comprise paint samples and the surface comprises an object or a portion of an image.

10 . The method of claim 7 , wherein the candidate product samples being clothing articles and the surface comprises a portion of an image.

11 . The method of claim 7 , further comprising illuminating the surface using a camera of the mobile device.

12 . The method of claim 7 , further comprising obtaining the spectrum of signals using a spectrometer connected to the mobile device.

13 . The method of claim 7 , further comprising accessing the stored representations of candidate product samples from a remote storage device.

14 . The method of claim 13 , wherein the remote storage device is in a cloud system.

15 . A mobile device comprising:
a light source; and a processor; wherein the mobile device is configured to:
illuminate a surface with the light source;
obtain a spectrum of signals reflected from the surface;
generate an averaged spectrum using the obtained spectrum and at least one other spectrum associated with the surface;
access stored representations of candidate product samples with the processor;
compare the averaged spectrum and the stored representations with the processor;
select with the processor at least one of the candidate product samples as a match to a color of the surface based on a comparison between the spectrum and the stored representations; and
incorporate a user's feedback of the selected one of the candidate product samples in future selections, wherein the user's feedback is ranked based on a level of satisfaction with the selected one of the product and classified based on one or more factors is included in the user's feedback for future selections.

16 . The mobile device of claim 15 , further comprising a display configured to provide at least one of the candidate product samples selected by the processor.

17 . The mobile device of claim 15 , wherein the mobile device further comprises a camera configured illuminate the surface.

18 . The mobile device of claim 15 , wherein the mobile device is connected to a spectrometer configured to obtain the spectrum of signals.

19 . The mobile device of claim 15 , wherein the mobile device is further configured to access the stored representations of candidate product samples from a remote storage device.

20 . The mobile device of claim 19 , wherein the remote storage device is in a cloud system.

Assignees

• Micron Technology Inc

Inventors

• Hu Yi
• Vengertsev Dmitry
• Hosseinimakarem Zahra
• Harms Jonathan D

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T7/97

  Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85) · CPC title

• G06N20/00

  Machine learning · CPC title

• G06T7/521

  from laser ranging, e.g. using interferometry; from the projection of structured light · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title