Complementary item recommendations using image feature data

Patent metadata

Field	Value
Publication number	US-9721192-B2
Application number	US-201615065122-A
Country	US
Kind code	B2
Filing date	Mar 9, 2016
Priority date	Sep 30, 2011
Publication date	Aug 1, 2017
Grant date	Aug 1, 2017

Abstract

An apparatus and method to facilitate finding complementary recommendations are disclosed herein. One or more fashion trend or pleasing color combination rules are determined based on data obtained from one or more sources. One or more template images and rule triggers corresponding to the fashion trend or pleasing color combination rules are generated, each of the rule triggers associated with at least one of the template images. A processor compares a first image attribute of a particular one of the template images to a second image attribute of each of a plurality of inventory images corresponding to the plurality of inventory items to identify the inventory items complementary to the query image. The particular one of the template images is selected based on the rule trigger corresponding to the particular one of the template images being applicable for a query image.

First claim

What is claimed is:

1. A system comprising:
one or more processors; and
a memory storing instructions that, when executed by the processor, causes the one or more processors to perform operations comprising:
determining a rule that correlates a first image attribute associated with a first item to a second image attribute associated with a second item, the rule being determined based on data obtained from one or more sources;
based on the rule, generating an image index and a corresponding usage condition for the image index;
receiving a query image from a user interface;
determining the usage condition for the image index is satisfied by the query image based on a comparison of an image attribute of the image index to an image attribute of the query image;
in response to reception of the query image, selecting the image index based on the usage condition for the image index being satisfied by the query image;
identifying a set of item images among a plurality of item images stored in a database, the set of item image being identified based on the selected image index and the usage condition; and
causing presentation, at the user interface, of the identified set of item images.

2. The system of claim 1 , wherein the operations further comprise:
wherein the causing of the presentation of the identified set of item images is performed as part of causing presentation of complementary images of the query image, the complementary images including the identified set of item images.

3. The system of claim 1 , wherein:
the image attribute of the image index is selected, based on a confidence score that corresponds to at least one of a visual pattern, a dominant color of the template image, or a directionality of a template image associated with the image index, from a group consisting of a color histogram of the template image, the dominant color of the template image, and an orientation histogram of the template image.

4. The system of claim 1 , wherein:
the data comprising of one or more trends specifying color combinations present in the identified one or more items.

5. The system of claim 1 , wherein:
the data comprising of one or more trends specifying information obtained from a group consisting of users purchase behavior data, expert knowledge data, and social network data.

6. The system of claim 5 , wherein:
the expert knowledge data includes an image that depicts a model wearing an outfit.

7. The system of claim 5 wherein:
the expert knowledge data include scientifically based color combination theory including a color scheme that indicate combinations of complementary colors or combinations of colors that create a color theme.

8. The system of claim 5 , wherein:
the social network data includes color, or patterns obtained from an online social network associated with a user.

9. The system of claim 1 , wherein:
the identified set of item images is included in a different category of items from a query item depicted in the query image.

10. A method comprising:
determining a rule that correlates a first image attribute associated with a first item to a second image attribute associated with a second item, the rule being determined based on data obtained from one or more sources;
based on the rule, generating an image index and a corresponding usage condition for the image index;
receiving a query image from a user interface;
determining the usage condition for the image index is satisfied by the query image based on a comparison of an image attribute of the image index to an image attribute of the query image;
in response to reception of the query image, selecting the image index based on the usage condition for the image index being satisfied by the query image;
identifying a set of item images among a plurality of item images stored in a database, the set of item image being identified based on the selected image index and the usage condition the identifying the set of item images being performed by a processor of a machine; and
causing presentation, at the user interface, of the identified set of item images.

11. The method of claim 10 , further comprising:
wherein the causing of the presentation of the identified set of item images is performed as part of causing presentation of complementary images of the query image, the complementary images including the identified set of item images.

12. The method of claim 10 , wherein:
the image attribute of the image index is selected, based on a confidence score that corresponds to at least one of a visual pattern, a dominant color of the template image, or a directionality of a template image associated with the image index, from a group consisting of a color histogram of the template image, the dominant color of the template image, and an orientation histogram of the template image.

13. The method of claim 10 , wherein:
the data comprising of one or more trends specifying color combinations present in the identified one or more items.

14. The method of claim 10 , wherein:
the data comprising of one or more trends specifying information obtained from a group consisting of users purchase behavior data, expert knowledge data, and social network data.

15. The method of claim 14 , wherein:
the expert knowledge data includes at least one of color science information, a color chart, a complementary color scheme, or a color theme.

16. The method of claim 14 , wherein:
the expert knowledge data includes an image that depicts a model wearing an outfit.

17. The method of claim 14 , wherein:
the expert knowledge data include scientifically based color combination theory including a color scheme that indicate combinations of complementary colors or combinations of colors that create a color theme.

18. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
determining a rule that correlates a first image attribute associated with a first item to a second image attribute associated with a second item, the rule being determined based on data obtained from one or more sources;
based on the rule, generating an image index and a corresponding usage condition for the image index;
receiving a query image from a user interface;
determining the usage condition for the image index is satisfied by the query image based on a comparison of an image attribute of the image index to an image attribute of the query image;
in response to reception of the query image, selecting the image index based on the usage condition for the image index being satisfied by the query image;
identifying a set of item images among a plurality of item images stored in a database, the set of item image being identified based on the selected image index and the usage condition; and
causing presentation, at the user interface, of the identified set of item images.

19. The non-transitory machine-readable storage medium of claim 18 , wherein the operations further comprise:
wherein the causing of the presentation of the identified set of item images is performed as part of causing presentation of complementary images of the query image, the complementary images including the identified set of item images.

20. The non-transitory machine-readable storage medium of claim 18 , wherein:
the image attribute of the image index is selected, based on a confidence score that corresponds to at least one of a visual pattern, a dominant colo

Assignees

• Ebay Inc

Inventors

• Bhardwaj Anurag
• Di Wei
• Jagadeesh Vignesh
• Piramuthu Robinson
• Sundaresan Neelakantan

Classifications

• G06T7/90 Primary

  Determination of colour characteristics · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06F18/21

  Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation · CPC title

• G06F16/532

  Query formulation, e.g. graphical querying · CPC title

• G06Q30/0629

  by pre-processing results, e.g. ranking or ordering results · CPC title