Product placement monitoring apparatus and method

Patent metadata

Field	Value
Publication number	US-2016307147-A1
Application number	US-201615091446-A
Country	US
Kind code	A1
Filing date	Apr 5, 2016
Priority date	Apr 15, 2015
Publication date	Oct 20, 2016
Grant date	—

Abstract

Methods and apparatuses are provided for use in monitoring inventory. Some embodiments provide a product inventory evaluation apparatus, comprising: an inventory tracking unit comprising: a transceiver; a control circuit coupled with the transceiver; and a memory coupled to the control circuit and storing computer instructions that when executed by the control circuit cause the control circuit to: receive one or more images of a floor of a shopping facility upon which multiple product support units are positioned and configured to store multiple different products; identify, in each of the one or more images, one or more shadows of at least a portion of one or more product support units; and determine, from the one or more shadows of at least the portion of the one or more product support units, whether a first product is present and stored relative to each of the one or more product support units.

First claim

What is claimed is:

1 . A product inventory evaluation apparatus, comprising:
an inventory tracking unit comprising:
a transceiver configured to couple with and receive communications from over a distributed network;
a control circuit coupled with the transceiver; and
a memory coupled to the control circuit and storing computer instructions that when executed by the control circuit cause the control circuit to:
receive one or more images of a floor of a shopping facility upon which multiple product support units are positioned and configured to store multiple different products;
identify, in each of the one or more images, one or more shadows of at least a portion of one or more product support units of the multiple product support units; and
determine, from the one or more shadows of at least the portion of the one or more product support units, whether a first product is present and stored relative to each of the one or more product support units.

2 . The product inventory evaluation apparatus of claim 1 , wherein the control circuit, in determining from the one or more shadows of at least the portion of the one or more product support units whether the first product is present, is further configured to:
detect a lack of a shadow relative to a first portion of a first shadow corresponding to a first shelf; and determine, based on the detected lack of the shadow, that a first portion of the first shelf is empty.

3 . The product inventory evaluation apparatus of claim 2 , wherein the control circuit, in detecting the lack of the shadow, identifies a shadow of a grating of the first shelf at the first portion of the first shadow.

4 . The product inventory evaluation apparatus of claim 1 , wherein the control circuit is further configured to:
cause a first light source, positioned proximate a first shelf of the one or more of a first product support unit causing the one or more shadows, to be turned on and cause a second light source to be turned off, wherein the second light source is positioned proximate to the first shelf and is separated from the first light source by a distance; and communicate an instruction to activate an image capturing unit to capture a first image of the one or more images while the first light source is on and the second light source is off.

5 . The product inventory evaluation apparatus of claim 4 , wherein the first light source emits light in a non-visible spectrum, and the control circuit is configured to leave ambient lights on while controlling the first and second light sources.

6 . The product inventory evaluation apparatus of claim 1 , wherein the control circuit, in determining from the one or more shadows of at least the portion of the one or more product support units whether the first product is present, is further configured to:
compare the one or more shadows in a first image comprising a shadow of at least a first shelf with a reference shadow of at least the first shelf; and determine a quantity of the first product as a function of a difference between the shadow of the first shelf in the first image and the reference shadow of the first shelf

7 . The product inventory evaluation apparatus of claim 1 , wherein the control circuit is further configure to:
evaluate a first shadow of the one or more shadows of one or more of the multiple product support units; determine, as a function of the evaluation of the first shadow, a location of the first shadow within the shopping facility; identify each of one or more shelves causing the first shadow based on the determined location of the first shadow; obtain, as specified in an inventory database, an expected inventory quantity value of the first product that is expected to be supported by the identified one or more shelves; and determine whether there is a difference between the expected inventory quantity value of the first product expected to be supported by the identified one or more shelves and a quantity of the first product, determined from the one or more shadows, that are stored relative to each of the one or more shelves.

8 . The product inventory evaluation apparatus of claim 1 , wherein the control circuit is further configure to:
determine a gradient offset between a first image of the floor of the one or more images and a reference image of the floor at a location where the first image is captured; and wherein the control circuit in identifying the one or more shadows of at least the portion of the one or more product support units is further configured to apply the gradient offset in distinguishing between the one or more shadows on the floor and the floor without a shadow.

9 . The product inventory evaluation apparatus of claim 1 , wherein the control circuit is further configured to:
identify a difference between a determined quantity of the first product, determined based on the one or more shadows of at least the portion of the one or more product support units, relative to an expected inventory quantity; and communicate a request to a shopping facility worker to audit the first product when the difference is greater than a difference threshold.

10 . The product inventory evaluation apparatus of claim 1 , wherein the control circuit in determining from the one or more shadows of at least the portion of the one or more product support units whether the first product is present is further configured to compare a height of a product support unit to a determined height of one or more products on a first shelf and determine a fullness of the first shelf based on the comparison of the product support unit height and the determined height of the one or more products on the first shelf.

11 . The product inventory evaluation apparatus of claim 10 , wherein the determining the height of the one or more products based on a distance between representations, in a first shadow, of notches on the product support unit.

12 . A method of evaluating inventory, comprising:
by a control circuit of an inventory system of a shopping facility: receiving one or more images of a floor of the shopping facility upon which multiple product support units are positioned and configured to store multiple different products; identifying, in each of the one or more images, one or more shadows of at least a portion of one or more product support units of the multiple product support units; and determining, from the one or more shadows of at least the portion of the one or more product support units, whether a first product is present and stored relative to each of the one or more product support units.

13 . The method of claim 12 , wherein the determining from the one or more shadows of at least the portion of the one or more product support units whether the first product is present, comprises:
detecting a lack of a shadow relative to a first portion of a first shadow corresponding to a first shelf; and determining based on the detected lack of the shadow, that a first portion of the first shelf is empty.

14 . The method of claim 13 , wherein the detecting the lack of the shadow comprises identifying a shadow of a grating of the first shelf at the first portion of the first shadow.

15 . The method of claim 12 , further comprising:
causing a first light source, positioned proximate a first shelf of the one or more of a first product support unit causing the one or more shadows, to be turned on and causing a second light source to be turned off, wherein the second light source is positioned proximate to the first shelf and is separated from the first light source by a distance; and

Assignees

• Wal Mart Stores Inc

Inventors

• Jones Nicholaus A
• Jones Matthew A
• Taylor Robert J
• Vasgaard Aaron J

Classifications

• G06V10/141

  Control of illumination · CPC title

• G06V10/60

  relating to illumination properties, e.g. using a reflectance or lighting model · CPC title

• G06T2207/10152

  Varying illumination · CPC title

• G06Q10/087 Primary

  Inventory or stock management, e.g. order filling, procurement or balancing against orders · CPC title

• G06K9/4661

  Physics · mapped topic