Automated product locker for inventory control

Patent metadata

Field	Value
Publication number	US-12045772-B2
Application number	US-201916409903-A
Country	US
Kind code	B2
Filing date	May 13, 2019
Priority date	May 13, 2019
Publication date	Jul 23, 2024
Grant date	Jul 23, 2024

Abstract

An automated product locker includes a housing and a drawer configured to be slidably stowable within the housing. The defines a storage area for storing product. Visual indicators on the product locker indicate respective positions, i.e., locations of the product within the storage area, so that desired products may located by the user. Upon withdrawal or closure of a door by a user, a machine vision system, such as a camera, may capture information about the product and inventory the product based, at least in part, on the information identified from images of the product obtaining by the machine vision system.

First claim

What is claimed:

1. An automated product locker, comprising:
a housing;
a drawer configured to be slidably stowable within the housing, the drawer defining a storage area comprising a plurality of slots configured to house a plurality of different products such that the plurality of different products may be placed at random in the storage area;
a plurality of visual indicators configured to indicate respective positions of respective units of the products within the storage area;
a machine vision system arranged within the housing and configured to capture information about the products; and
a controller arranged within the housing and operably coupled to the machine vision system, the controller comprising a processor and a memory, the memory having computer-executable instructions stored thereon that, when executed by the processor, cause the controller to:
detect an opening or closing of the drawer by a user, and, upon detecting the opening or closing to:
(i) cause the camera to capture at least one image of the products, wherein the at least one image comprises information about the products; and
(ii) inventory the products based, at least in part, on the information about the products, wherein inventorying the product based, at least in part, on the information about the product comprises:
receiving images of the products captured by the camera;
analyzing the images of the products to identify respective product identifiers associated with respective units of the product or an absence of product previously stored in the housing;
decoding the respective product identifiers associated with the respective units of the products; and
using the respective product identifiers, associating the respective units of the product with the respective positions within the storage area;
determining a product inventory update based on the respective product identifiers or the absence of product previously stored in the housing;
causing the controller to transmit the product inventory

update over a network to a database of a remote system; and

cause one or more of the visual indicators that are associated with a desired unit of the products to actuate; and
wherein inventorying the products based, at least in part, on the information about the products further comprises analyzing the images of the products to determine, using a machine learning algorithm, a source of each of the respective units of the products.

2. The automated product locker of claim 1 , wherein the drawer comprises an external face, and wherein at least one of the visual indicators is arranged on or adjacent to the external face.

3. The automated product locker of claim 1 , wherein the drawer further comprises a plurality of partitions arranged within the storage area, and wherein a respective set of the visual indicators is arranged along each of the partitions.

4. The automated product locker of claim 3 , wherein the drawer further comprises a plurality of trays configured to receive the product, wherein each of the trays is arranged between adjacent partitions.

5. The automated product locker of claim 4 , wherein the plurality of slots reside within the trays.

6. The automated product locker of claim 1 , wherein the optical device is a barcode scanner.

7. The automated product locker of claim 6 , wherein inventorying the product based, at least in part, on the information about the product comprises:
reading respective product identifiers associated with respective units of the products;
decoding the respective product identifiers associated with the respective units of the products; and
using the respective product identifiers, associating the respective units of the products with the respective positions within the storage area.

8. The automated product locker of claim 7 , wherein each of the respective product identifiers is a one-dimensional (1D) barcode, a universal product code (UPC), or a stock keeping unit (SKU).

9. The automated product locker of claim 1 , wherein each of the respective product identifiers is a one-dimensional (1D) barcode, a two-dimensional (2D) barcode, a three-dimensional (3D) barcode, a universal product code (UPC), a stock keeping unit (SKU), text, or a graphic.

10. The automated product locker of claim 1 , wherein inventorying the products based, at least in part, on the information about the products further comprises analyzing the images of the products to identify one or more of the respective positions within the storage area associated with a missing, unrecognized, or unreadable product identifier.

11. The automated product locker of claim 10 , wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to determine, using a machine learning algorithm, whether the one or more of the respective positions within the storage area associated with the missing, unrecognized, or unreadable product identifier contain a unit of the products.

12. The automated product locker of claim 1 , wherein inventorying the products based, at least in part, on the information about the products further comprises cropping a portion of the images of the products, and wherein the cropped portion of the images is analyzed to identify the respective product identifiers associated with the respective units of the product.

13. The automated product locker of claim 1 , wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to store the images of the products in the memory.

14. The automated product locker of claim 1 , wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to transmit the images of the products over a network to a remote system.

15. The automated product locker of claim 1 , wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to initiate the machine vision system in response to a movement of the drawer.

16. The automated product locker of claim 15 , wherein the movement of the drawer is withdrawal of the drawer from the housing followed by return of the drawer into the housing.

17. The automated product locker of claim 15 , further comprising a position detector configured to sense a position of the drawer relative to the housing.

18. The automated product locker of claim 17 , wherein the position detector is a through-beam photoelectric sensor.

19. The automated product locker of claim 15 , further comprising a position strip including machine readable code arranged within the drawer, wherein the machine vision system is further configured to capture information about the position strip, and wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to detect the movement of the drawer based, at least in part, on the information about the position strip.

20. The automated product locker of claim 1 , wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to receive a request for the desired unit of the products.

21. The automated product locker of claim 20 , wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to:
transmit the req

Assignees

• Johnson & Johnson Vision Care

Inventors

• Kernick Edward R
• Scolaro James
• Voss Leslie A
• Tawfik Ahmed
• Lee Kyungmin Andy

Classifications

• G07F11/18

  Recessed drawers · CPC title

• G06T7/0002

  Inspection of images, e.g. flaw detection · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06K7/1408

  the method being specifically adapted for the type of code · CPC title

• G06N20/00

  Machine learning · CPC title