Product identification systems and methods

Patent metadata

Field	Value
Publication number	US-11526843-B2
Application number	US-202016864676-A
Country	US
Kind code	B2
Filing date	May 1, 2020
Priority date	May 1, 2020
Publication date	Dec 13, 2022
Grant date	Dec 13, 2022

Abstract

A method for identifying a product removed from a cabinet includes detecting visual characteristics of the product removed from the cabinet by a camera within the cabinet. The method may include detecting an identifier on the product removed from the cabinet by an identifier sensor, and comparing the visual characteristics and the identifier to a database of product information. The product removed from the cabinet may be identified based on the comparison of the visual characteristics and the identifier to the database of product information.

First claim

What is claimed is:

1. A method for identifying a product removed from a cabinet, comprising:
storing the product in a product storage area of a cabinet, wherein the product storage area is accessible to a consumer via a door to allow for the consumer to select the product to be purchased;
detecting visual characteristics of the product removed from the cabinet by a camera within the cabinet when the door of the cabinet is opened;
detecting an identifier on the product removed from the cabinet by an identifier sensor;
comparing the visual characteristics and the identifier to a database of product information; and
identifying the product removed from the cabinet based on the comparison of the visual characteristics and the identifier to the database of product information.

2. The method of claim 1 , wherein the visual characteristics comprises a shape of the product.

3. The method of claim 1 , wherein the visual characteristics comprises a coloring of the product.

4. The method of claim 1 , wherein the identifier sensor is the camera.

5. The method of claim 1 , wherein the identifier is a barcode.

6. The method of claim 1 , further comprising:
confirming the identity of the product by determining a weight of the product removed from the cabinet with a weight sensor arranged within the cabinet.

7. The method of claim 6 , wherein determining the weight of the product removed from the cabinet comprises:
determining a first weight of products in the cabinet via the weight sensor;
determining a second weight of products in the cabinet via the weight sensor after removing the product from the cabinet; and
calculating a difference between the first weight and the second weight.

8. The method of claim 1 , further comprising:
detecting a visual characteristic of the product removed from the cabinet at a location outside of the cabinet by an external camera; and
confirming the identity of the product removed based on the visual characteristic detected by the external camera.

9. The method of claim 1 , further comprising:
detecting the consumer by an external camera;
detecting by the external camera unauthorized conduct by the consumer; and
locking the cabinet when the unauthorized conduct is detected.

10. The method of claim 1 , further comprising:
detecting data relating to the product removed via an optical sensor; and
confirming the identity of the product removed using the data from the optical sensor.

11. The method of claim 1 , wherein the camera is one of a plurality of cameras arranged at a perimeter of a front portion of the cabinet.

12. A method for identifying a product removed from a cabinet, comprising:
storing a plurality of products within a cabinet, wherein the cabinet comprises a door that is openable by a consumer to access the plurality of products;
capturing a first image of the plurality of products within the cabinet by an internal camera within the cabinet prior to the consumer accessing the cabinet;
capturing a second image of the plurality of products within the cabinet by the internal camera after the consumer accesses the cabinet;
determining an identity of a product removed from the cabinet by analyzing the first image and the second image; and
confirming the identity of the product removed from the cabinet by detecting an identifier of the product removed from the cabinet.

13. The method of claim 12 , further comprising:
confirming the identity of the product by detecting a weight of the product removed from the cabinet via a weight sensor.

14. The method of claim 12 , further comprising:
detecting a visual characteristic of the product removed from the cabinet at a location outside of the cabinet by an external camera; and
confirming the identity of the product removed based on the visual characteristic detected by the external camera.

15. The method of claim 12 , further comprising:
detecting data relating to the product removed via an optical sensor; and
confirming the identity of the product removed using the data from the optical sensor.

16. The method of claim 15 , wherein the optical sensor comprises a LIDAR sensor.

17. A method for identifying a product removed from a cabinet, comprising:
detecting a location from which the product was removed from the cabinet via at least one of a camera and a sensor;
determining a visual characteristic of the product based on data from the at least one of a camera and a sensor;
determining a predicted identity of the product based on the visual characteristic;
determining an identity of the product at the location based on a digital map of products within the cabinet, wherein the digital map is generated using data received from the at least one of a camera and a sensor, and wherein the digital map comprises a location and identity of each product within the cabinet; and
confirming that the predicted identity of the product corresponds to the identity of the product based on the digital map.

18. The method of claim 17 , further comprising:
updating the digital map of products within the cabinet after the product is removed from the cabinet.

19. The method of claim 17 , further comprising detecting an identifier of the product removed from the cabinet via an identifier sensor.

Assignees

• Pepsico Inc

Inventors

• Li Xuejun
• Serock Yong Jin
• Lau Cheuk Chi

Classifications

• G06Q30/0185 Primary

  Product, service or business identity fraud · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06Q10/087 Primary

  Inventory or stock management, e.g. order filling, procurement or balancing against orders · CPC title

• G06V10/751

  Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching · CPC title

• G06Q20/18

  involving self-service terminals [SST], vending machines, kiosks or multimedia terminals · CPC title