Method and system for color capture and presentation enhancement

Patent metadata

Field	Value
Publication number	US-10304125-B1
Application number	US-201615055281-A
Country	US
Kind code	B1
Filing date	Feb 26, 2016
Priority date	Feb 26, 2016
Publication date	May 28, 2019
Grant date	May 28, 2019

Abstract

Creating color swatches associated with a product based on capturing an image of the product applied to a model substrate is described. In an example, an image of a product on a color display mechanism may be accessed. At least a portion of the color display mechanism may include a model substrate that is substantially similar to an intended application substrate for the product. A color swatch corresponding to the product may be determined based at least in part on the image. An enhanced image may be generated based at least partly on the color swatch. The enhanced image may be an image depicting the product applied to the intended application substrate in an environment of use that is modified to include a color associated with the color swatch in a region of the image corresponding to the product.

First claim

What is claimed is:

1. A method comprising:
selecting a model substrate that is based at least in part on a first color of an intended application substrate for a product and at least one of a degree of transparency, an absorbency, a texture, or a finish of the intended application substrate for the product;
applying the product to the model substrate in a manner based at least in part on an expected application;
accessing, via a computing device, a first image of the product applied to the model substrate;
determining, via the computing device, a color swatch corresponding to the product based at least in part on the first image, the color swatch representing a second color of the product that is perceived based at least in part on the product interacting with the model substrate;
generating, via the computing device, an enhanced image based at least in part on:
accessing a second image depicting the product applied to the intended application substrate in an environment of use, the second image being associated with a first layer of the enhanced image;
positioning a second layer associated with the color swatch under the first layer to cause the second color to be applied to a region of the second image associated with the product; and
positioning a third layer associated with a parameter on top of the first layer, the parameter being associated with at least one of a highlight or a shadow;

generating, via the computing device, a user interface configured to present information about the product to a user, the user interface including the enhanced image; and
causing, via the computing device, the user interface to be presented to the user via a display of a device associated with the user.

2. The method of claim 1 , further comprising:
accessing a third image of the product on the intended application substrate in an environment of use;
performing image processing on the third image; and
determining the parameter based at least in part on the image processing on the third image.

3. The method of claim 1 , further comprising determining the color swatch corresponding to the product based at least in part on:
selecting a plurality of pixels from an area of the first image where at least a portion of the model substrate is visible under the product, individual pixels of the plurality of pixels being associated with different colors; and
determining the second color based at least in part on averaging the individual pixels of the plurality of pixels.

4. The method of claim 1 , wherein the intended application substrate is skin and the first color corresponds to skin tone.

5. A method comprising:
accessing, by a computing device, a first image of a product on a color display mechanism, at least a portion of the color display mechanism including a model substrate having a first color and a first characteristic that are selected based at least in part on an intended application substrate for the product;
determining, by the computing device, a color swatch corresponding to the product based at least in part on the first image, the color swatch corresponding to a plurality of pixels of different colors that collectively represent a second color of the product as it is perceived based at least in part on the product interacting with the model substrate; and
generating, by the computing device, an enhanced image based at least in part on:
a first layer comprising a second image depicting the product applied to the intended application substrate in an environment of use;
a second layer comprising the second color in a region associated with the second image corresponding to the product; and
a third layer associated with a parameter, the parameter associated with at least one of a highlight or a shadow.

6. The method of claim 5 , wherein the first characteristic is at least one of a degree of opacity, a degree of transparency, an absorbency, a texture, or a finish.

7. The method of claim 5 , wherein the first characteristic is a same variation of color within the intended application substrate.

8. The method of claim 5 , further comprising:
receiving input from a user indicating that a particular intended application substrate for the product is a third color; and
determining that a degree of color separation between the first color and the third color is less than a threshold; and
wherein generating the enhanced image is further based at least in part on determining that the degree of color separation is less than the threshold.

9. The method of claim 5 , further comprising:
receiving input from a user indicating that a particular intended application substrate for the product is a third color;
determining that a degree of color separation between the first color and the third color is greater than a threshold; and
wherein generating the enhanced image is further based at least in part on:
positioning the second layer under the first layer to cause the second color to be applied to the region; and
causing the third layer to be positioned on top of the first layer to affect changes to the second color caused at least in part by the third color.

10. The method of claim 5 , further comprising:
determining a second characteristic associated with the product; and
wherein generating the enhanced image is further based at least in part on causing the third layer to be positioned on top of the first layer to affect changes in an appearance of the product caused at least in part by the second characteristic.

11. The method of claim 5 , further comprising:
receiving input from a user indicating at least one of the first color or the first characteristic; and
based at least in part on receiving the input from the user, generating the enhanced image in real time or near real time.

12. The method of claim 5 , wherein generating the enhanced image is further based at least in part on:
masking out a portion of the second image corresponding to the region; positioning the second layer under the first layer to cause the second color to show through the portion of the second image corresponding to the region; and
positioning the third layer on top of the first layer.

13. The method of claim 5 , further comprising:
determining that the product is likely to be of interest to a user based at least in part on user actions associated with at least one of a retail purchase account associated with the user or third-party sources and systems; and
generating a user interface configured to present information about the product to the user, the user interface including the enhanced image.

14. A system comprising:
an image processing device to capture a first image of a cosmetic product that is disposed on a model substrate that is selected based at least in part on a portion of a body corresponding to an intended application substrate;
one or more processors; and
a memory that stores one or more computer-executable instructions that are executable by the one or more processors to cause the system to perform operations comprising:
determining, based at least in part on the first image, a color swatch corresponding to the cosmetic product, the color swatch including a plurality of pixels of different colors that collectively represent a color of the cosmetic product that is disposed on the intended application substrate; and
generating an enhanced image based at least in part on:
a first layer comprising a second image depicting the cosmetic product applied to the intended application substrate;
a second layer comprising the color in a region associated with the second image, wherein the second layer is positio

Assignees

• Amazon Tech Inc

Inventors

• Huisenga Peter Ross
• Dankworth Lindsay Evje
• Dogan Muge Erdirik
• Esparza Matthew Edward
• Galore Janet Ellen
• Rautenberg Iii Robert Allan
• Trousdale Kara Clover
• Virani Amirali
• Walter Daniel Joseph
• Dorner Charles Shearer

Classifications

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06V40/10

  Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title