Systems and methods of object identification and database creation

Patent metadata

Field	Value
Publication number	US-10289928-B2
Application number	US-201816134407-A
Country	US
Kind code	B2
Filing date	Sep 18, 2018
Priority date	Sep 28, 2015
Publication date	May 14, 2019
Grant date	May 14, 2019

Abstract

Exemplary embodiments are generally directed to systems and methods of object identification. Exemplary embodiments can scan, by an optical reader, a machine-readable identifier associated with an original object. Exemplary embodiments can capture an image of the original object at a first orientation using an image capture device. Exemplary embodiments can transmit the machine-readable identifier and the image of the original object to an image database to store an association between the image of the original object and the machine-readable identifier. Exemplary embodiments can receive a subsequent object having a subsequent machine-readable identifier that is unavailable or incapable of being scanned. Exemplary embodiments can capture an image of the subsequent object with the image capture device. Exemplary embodiments can execute an image recognition function that outputs object identification information for the image of the subsequent object based on the machine-readable identifier associated with the image of the original object.

First claim

The invention claimed is:

1. A method of identifying objects using image recognition, comprising:
scanning, by a reader, a machine-readable identifier associated with an original object;
capturing an image of the original object at a first orientation using an image capture device, the image capture device disposed remotely from the reader;
transmitting the machine-readable identifier and the image of the original object to an image database to store an association between the image of the original object and the machine-readable identifier;
receiving a subsequent object having a subsequent machine-readable identifier that is unavailable or incapable of being scanned;
capturing an image of the subsequent object with the image capture device;
executing an image recognition function that receives as input the image of the subsequent object, compares the image of the subsequent object to other images in the image database to identify similar images, the similar images including at least the image of the original object, and that outputs, via a graphical user interface, a set of images from the image database as potential matches with the image of the subsequent object, the set of images from the image database output as potential matches including the image of the original object,
wherein scanning the machine-readable identifier associated with the original object with the reader actuates the image capture device to automatically capture the image of the original object.

2. The method of claim 1 , comprising selecting, via the graphical user interface, one of the images in the set of images output to as selected potential match that corresponds with the subsequent object.

3. The method of claim 2 , comprising outputting object identification information for the selected potential match of the subsequent object based on the machine-readable identifier associated with the selected potential match, the object identification information identifying the subsequent object relative to the other images in the image database.

4. The method of claim 3 , comprising displaying the object identification information at the graphical user interface.

5. The method of claim 1 , comprising displaying, via the graphical user interface, the set of images output as potential matches as a grid of selectable images.

6. The method of claim 1 , comprising capturing the image of the original object at the first orientation using the image capture device and capturing a second image of the original object at a second orientation using a second image capture device, the first and second orientation being different.

7. The method of claim 6 , wherein scanning the machine-readable identifier associated with the original object with the reader actuates the image capture device and the second image capture device to automatically and substantially simultaneously capture the images of the original object.

8. The method of claim 6 , comprising transmitting the second image of the original object to the image database to store an association between the image of the original object, the second image of the original object and the machine-readable identifier.

9. The method of claim 1 , wherein the reader is at least one of a barcode scanner or a radio-frequency identification scanner.

10. The method of claim 1 , wherein the image capture device comprises one or more cameras.

11. The method of claim 1 , comprising associating the object information data of the original object obtained from scanning the machine-readable identifier associated with the original object with the image of the original object in the image database.

12. The method of claim 11 , wherein the object identification information comprises at least one of an object name, an object description, or an object cost.

13. The method of claim 1 , wherein the reader is an optical reader.

14. A system for imaging of objects and machine-readable identifiers associated with the objects, the system comprising:
a reader, the reader being configured to read a machine-readable identifier associated with an original object;
an image capture device, the image capture device being configured to (i) capture an image of the original object, and (ii) capture an image of a subsequent object, the subsequent object having a subsequent machine-readable identifier that is unavailable or incapable of being read;
an image database configured to store an association between the image of the original object and the machine-readable identifier associated with the original object; and
a processing device operatively coupled to the reader, the image capture device and the image database, wherein the processing device is configured to execute an image recognition function that receives as input the image of the subsequent object, compares the image of the subsequent object to other images in the image database to identify similar images, the similar images including at least the image of the original object, that outputs, via a graphical user interface, a set of images from the image database as potential matches with the image of the subsequent object, the set of images from the image database output as potential matches including the image of the original object,
wherein scanning the machine-readable identifier associated with the original object with the reader actuates the image capture device to automatically capture the image of the original object.

15. The system of claim 14 , wherein the processing device is configured to allow selection, via the graphical user interface, one of the images in the set of images as a selected potential match that correspond with the subsequent object, and output object identification information for the selected potential match of the subsequent object based on the machine-readable identifier associated with the selected potential match, the object identification information identifying the subsequent object relative to the other images in the image database.

16. The system of claim 14 , wherein the image capture device is disposed remotely from the reader.

17. The system of claim 14 , wherein reading of the machine-readable identifier associated with the object with the reader actuates the image capture device to automatically capture the image of the object.

18. The system of claim 17 , wherein the reader comprises a handheld or portable optical reader.

19. The system of claim 18 , wherein the image capture device is incorporated into the handheld or portable optical reader.

20. The system of claim 14 , wherein the reader is an optical reader.

Assignees

• Walmart Apollo Llc

Inventors

• Johnson Christopher Soames
• Clark Jimmie Russell
• Payne Michael Lawerance

Classifications

• G07G1/0018 Primary

  Constructional details, e.g. of drawer, printing means, input means · CPC title

• G06V10/75

  Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G07G1/0045

  with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader · CPC title

• G06Q10/00

  Administration; Management · CPC title