Identification of items depicted in images

Patent metadata

Field	Value
Publication number	US-9495386-B2
Application number	US-37188209-A
Country	US
Kind code	B2
Filing date	Feb 16, 2009
Priority date	Mar 5, 2008
Publication date	Nov 15, 2016
Grant date	Nov 15, 2016

Abstract

In an example embodiment, a method of identifying an item depicted in an image is provided. In this method, the image depicting the item is accessed; in addition, other images and their item identifiers are also accessed. A match of the image with one of the other images is identified. The match can be based on a variety of matching techniques, such as the application of an edge detection algorithm and the conversion of the images into color histograms. With a match, the image is then associated with an item identifier of the matched image. In one example, a template associated with one of the item identifiers can be accessed.

First claim

What is claimed is:

1. A method of identifying an item depicted in a first image, the method comprising:
receiving a request to identify the item, the request including the first image;
accessing a plurality of other images and a plurality of associated item data, the plurality of associated item data including a description in each of a plurality of item listings;
parsing the plurality of associated item data to identify a plurality of item identifiers associated with the plurality of other images;
calculating at least one statistical difference between a first color histogram of the first image and a color histogram of each of the plurality of other images;
determining a second color histogram of a second image as having a lowest calculated statistical difference among the at least one statistical difference between the first color histogram and the color histogram of each of the plurality of other images;
detecting a first edge in the first image and a second edge in the second image;
identifying a match of the first color histogram with the second color histogram responsive to determining the second color histogram as having the lowest calculated statistical difference among the at least one statistical difference, the identifying being based on the detection of the first edge in the first image and the second edge in the second image, the second image depicting a second item that corresponds to a barcode among the plurality of item identifiers;
associating the first image with the barcode that corresponds to the second item depicted in the second image based on the match of the first and second color histograms of the first and second images;
accessing a template associated with the barcode that corresponds to the second item depicted in the second image based on the match of the first and second color histograms of the first and second images; and
transmitting the template in a response to the request.

2. The method of claim 1 , wherein the identification of the match of the first color histogram with the second color histogram comprises comparing the first image with the second image.

3. The method of claim 1 , wherein the identification of the match comprises:
converting the first image into the first color histogram;
converting the second image into the second color histogram; and
comparing the first color histogram with the second color histogram.

4. A non-transitory, machine-readable medium that stores instructions that, when performed by one or more processors of a machine, cause the machine to perform operations comprising:
accessing a first image depicting an item;
accessing a plurality of other images and a plurality of associated item data, the plurality of associated item data including a description in each of a plurality of item listings;
parsing the plurality of associated item data to identify a plurality of item identifiers associated with the plurality of other images;
calculating at least one statistical difference between a first color histogram of the first image and a color histogram of each of the plurality of other images;
determine a second color histogram of the second image as having a lowest calculated statistical difference among the at least one statistical difference between the first color histogram and the color histogram of each of the plurality of other images;
detecting a first edge in the first image and a second edge in the second image;
identifying a match of the first color histogram with the second color histogram responsive to determining the statistical difference between the first color histogram and the second color histogram as having the lowest statistical difference among the at least one statistical difference, the identifying being based on the detection of the first edge in the first image and the second edge in the second image, the second image depicting a second item that corresponds to a barcode among the plurality of item identifiers;
associating the first image with the barcode that corresponds to the second item depicted in the second image based on the match of the first and second color histograms of the first and second images, the association identifying the item in the first image; and
accessing a template associated with the barcode that corresponds to the second item depicted in the second image based on the match of the first and second color histograms of the first and second images.

5. The non-transitory, machine-readable medium of claim 4 , wherein the operation of identifying the match of the first color histogram with the second color histogram comprises comparing the first image with the plurality of other images.

6. The non-transitory, machine-readable medium of claim 4 , wherein the operation of identifying the match comprises:
converting the first image into the first color histogram;
converting the second image into the second color histogram; and
comparing the first color histogram with the second color histogram.

7. The non-transitory, machine-readable medium of claim 4 , wherein the instructions, when performed by a machine, cause the machine to perform operations further comprising:
receiving a request to identify the item depicted in the first image;
accessing a plurality of item data associated with the item identifier that corresponds to the second image; and
transmitting a response to the request, the response including the plurality of item data and the item identifier that corresponds to the second image.

8. The non-transitory, machine-readable medium of claim 7 , wherein the plurality of item data associated with the item identifier that corresponds to the second image includes a description of the item.

9. The non-transitory, machine-readable medium of claim 7 , wherein the plurality of item data associated with the item identifier that corresponds to the second image includes a location of the item.

10. The non-transitory, machine-readable medium of claim 4 , wherein the edge detection algorithm is a Canny edge detector algorithm.

11. A processing system comprising:
at least one processor; and
a memory in communication with the at least one processor, the memory being configured to store an item recognition module that is executable by the at least one processor, the item recognition module having instructions, that when executed by the at least one processor, cause operations to be performed, the operations comprising:
accessing a first image depicting an item;
accessing a plurality of other images and a plurality of associated item data, the plurality of associated item data including a description in each of a plurality of item listings;
parsing the plurality of associated item data to identify a plurality of item identifiers associated with the plurality of other images;
calculating at least one statistical difference between a first color histogram of the first image and a color histogram of each of the plurality of other images;
determining a second color histogram of a second image as having a lowest calculated statistical difference among the at least one statistical difference between the first color histogram and the color histogram of each of the plurality of other images;
detecting a first edge in the first image and a second edge in the second image;
identifying a match of the first color histogram with the second color histogram responsive to determining the second color histogram as having the lowest calculated statistical difference among the at least one statistical difference, the identifying being based on the detection of the first edge in the first image and the second edge in the second image, the second image depicting a second item that co

Assignees

• Tapley John
• Farraro Eric J
• Gupta Raghav
• Grandhi Roopnath
• Ebay Inc

Inventors

• Tapley John
• Farraro Eric J
• Gupta Raghav
• Grandhi Roopnath

Classifications

• G06V10/56 Primary

  relating to colour · CPC title

• G06Q30/0623

  by investigating goods or services · CPC title

• G06T7/13

  Edge detection · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F16/434

  using image data, e.g. images, photos, pictures taken by a user · CPC title