Goods monitoring device, goods monitoring system, and goods monitoring method

Patent metadata

Field	Value
Publication number	US-10445693-B2
Application number	US-201515504174-A
Country	US
Kind code	B2
Filing date	Jul 16, 2015
Priority date	Sep 11, 2014
Publication date	Oct 15, 2019
Grant date	Oct 15, 2019

Abstract

This device is configured to include a state monitoring area setter that sets a state monitoring area on the image of the display area, an item detector that detects item displayed in the state monitoring area, based on the image of the display area, a display state determinator that determines a display state of item in the state monitoring area, based on a detection result by the item detector, and a display screen generator that generates a monitoring screen including a monitoring image in which a display state displaying image representing the display state of item in the state monitoring area is superimposed on the image of the display area, based on a determination result by the display state determinator.

First claim

The invention claimed is:

1. An item monitoring device which monitors a display status of item based on a captured image of a display area in a store, the item monitoring device comprising:
a processor that
sets a state monitoring area on the image of the display area;
detects an item displayed in the state monitoring area, based on an item occupancy rate in each state monitoring area;
determines a display state of item in the state monitoring area, based on the detected item displayed in the state monitoring area; and
generates a monitoring screen including a monitoring image in which a display state displaying image representing the display state of item in the state monitoring area is superimposed on the image of the display area, based on the determined display state,

wherein the processor calculates a proportion occupied by pixels of one or more objects corresponding to the item in the image of the display area for determining the item occupancy rate, and
wherein the processor changes a display color of the display state displaying image depending on the display state.

2. An item monitoring device which monitors a display status of item based on a captured image of a display area in a store, the item monitoring device comprising:
a processor that
sets a state monitoring area on the image of the display area;
detects an item displayed in the state monitoring area, based on an item occupancy rate in each state monitoring area;
determines a display state of item in the state monitoring area, based on the detected item displayed in the state monitoring area; and
generates a monitoring screen including a monitoring image in which a display state displaying image representing the display state of item in the state monitoring area is superimposed on the image of the display area, based on the determined display state,

wherein the processor calculates a proportion occupied by pixels of one or more objects corresponding to the item in the image of the display area for determining the item occupancy rate, and
wherein the display state displaying image is a frame image representing the state monitoring area that is set on the image of the display area.

3. The item monitoring device of claim 1 , further comprising:
a memory that stores the detected item displayed in the state monitoring area and the determined display state, as display state information,
wherein the processor generates a time chart illustrating temporal transition of the display state of item, based on the display state information, and displays the time chart and the monitoring image on the monitoring screen.

4. The item monitoring device of claim 1 , wherein the processor further
determines propriety of a notification instructing a store staff member to perform an item management work, based on the determined display state, and
generates the notification, based on the detected item displayed in the state monitoring area,
wherein the processor calculates a determination on at least one of a display disturbance state and a display shortage state, as the display state, and
wherein the processor generates a notification instructing a store staff member to perform at least any one of an arranging work to resolve a disturbance in display, and a replenishing work to resolve shortage of item, as the item management work.

5. The item monitoring device of claim 1 ,
wherein the processor causes to display a character representing the display state of item on the monitoring screen, in a state corresponding to the state monitoring area of the monitoring image, based on the determined display state.

6. The item monitoring device of claim 1 , wherein the processor further:
executes a process for detecting a caution event which needs to urge caution to a user regarding the display state of item, based on the determined display state, and
wherein the processor causes to display a message display portion indicating the contents of the caution event, based on the detected caution event.

7. The item monitoring device of claim 1 , further comprising:
a memory that stores the detected item displayed in the state monitoring area and the determined display state, as display state information;
wherein the processor further
acquires sales information on a sales situation of item in a store;
executes a statistical process on the sales information with time to generate statistical information on the sales situation of item;
acquires a caution point at which a sales opportunity loss is expected to occur, based on the statistical information; and
generates a time chart illustrating temporal transition of the display state and the sales situation of item, based on the display state information and the statistical information, and causes to display a caution image representing a caution point by superimposing the caution image on the time chart.

8. The item monitoring device of claim 1 , further comprising:
a memory that stores the detected item displayed in the state monitoring area and the determined display state, as display state information,
wherein the processor further
acquires work schedule information on a work schedule specifying a timing to be implemented of an item management work, and
generates a time chart illustrating temporal transition of the display state of item, based on the display state information, and causes to display a timing image representing a timing to be implemented by superimposing the timing image on the time chart.

9. The item monitoring device of claim 1 , further comprising:
a memory that stores the detected item displayed in the state monitoring area and the determined display state, as display state information,
wherein the processor further
acquires work schedule information on a work schedule specifying a timing to be implemented of an item management work,
acquires a delay period required up to the timing at which the item management work is supposed to be executed, from a timing to be implemented of the item management work, based on the display state information and the work schedule information, and
generates a time chart illustrating temporal transition of the display state of item, based on the display state information, and causes to display a delay image representing a delay period by superimposing the delay image on the time chart.

10. An item monitoring system which monitors a display status of item based on a captured image of a display area in a store, the item monitoring system comprising:
a camera that captures an image of the display area; and
a plurality of information processing devices,
wherein any one of the plurality of information processing devices includes
a processor that
sets a state monitoring area on the image of the display area;
detects an item displayed in the state monitoring area, based on an item occupancy rate in each state monitoring area;
determines a display state of item in the state monitoring area, based on the detected item displayed in the state monitoring area; and
generates a monitoring screen including a monitoring image in which a display state displaying image representing the display state of item in the state monitoring area is superimposed on the image of the display area, based on the determined display state,

wherein the processor calculates a proportion occupied by pixels of one or more objects corresponding to the item in the image of the display area for determining the item occupancy rate, and
wherein the processor changes a display color of the display state displaying image depending on the display state.

11. An item monitoring method causing an information processing device to implement a process

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Takemoto Yuichiro

Classifications

• G06T11/26

  Drawing of charts or graphs · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06Q10/087 Primary

  Inventory or stock management, e.g. order filling, procurement or balancing against orders · CPC title

• G08B21/24

  Reminder alarms, e.g. anti-loss alarms · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title