Commodity monitoring device, commodity monitoring system, output destination device, commodity monitoring method, display method and program

Patent metadata

Field	Value
Publication number	US-2020005231-A1
Application number	US-201716490398-A
Country	US
Kind code	A1
Filing date	Dec 11, 2017
Priority date	Mar 6, 2017
Publication date	Jan 2, 2020
Grant date	—

Abstract

A commodity monitoring device includes a commodity state detection unit configured to, on the basis of image information of a commodity group area set on a commodity shelf, detect removal of a commodity in a quantity satisfying a predetermined condition from the commodity group area; and a change detection information output unit configured to, if the commodity state detection unit has detected the removal, output to an output destination device change detection information including image time-series data of the commodity group area from a point in time at which the commodity state detection unit detected the removal to a predetermined past point in time.

First claim

1 . A commodity monitoring device comprising:
at least one memory configured to store instructions; and at least one processor configured to execute the instructions to; detect removal of a commodity in a quantity satisfying a predetermined condition from the commodity group area, based on image information of a commodity group area including a commodity shelf; and output, to an output destination device, change detection information including image time-series data of the commodity group area from a point in time at which the removal has been detected to a predetermined past point in time, in the case where the removal has been detected.

2 . The commodity monitoring device according to claim 1 ,
wherein the at least one processor is configured to acquire sales information indicating sales history of the commodity, after the removal has been detected, and output the change detection information including the sales information to the output destination device.

3 . The commodity monitoring device according to claim 1 ,
wherein the at least one processor is configured to, after outputting the change detection information to the output destination device, acquire sales information indicating sales history of the commodity after the removal has been detected, and output the sales information to the output destination device.

4 . The commodity monitoring device according to claim 2 ,
wherein the at least one processor is configured to acquire sales information registered in a sales information management device within a predetermined time after the removal has been detected.

5 . The commodity monitoring device according to claim 4 ,
wherein the at least one processor is configured to, in the case where sales information relating to the commodity is not acquired from the sales information management device within a predetermined time after the removal has been detected, output the change detection information not including the sales information to the output destination.

6 . The commodity monitoring device according to claim 1 ,
wherein the at least one processor is configured to, based on past image of the commodity group area before the removal has been detected, acquire information relating to a person who removed the commodity and output the information relating to the person who removed the commodity to the output destination device.

7 . The commodity monitoring device according to claim 1 ,
wherein the at least one processor is configured to, based on past image of the commodity group area before the removal has been detected, detect information relating to a person who removed the commodity and, after outputting the change detection information to the output destination device, output the information relating to the person to the output destination device.

8 . The commodity monitoring device according to claim 7 ,
wherein the at least one processor is configured to, based on information relating to the person who removed the commodity, determine whether the person passed the commodity through a predetermined checkout area and, in the case of having determined that the commodity was not passed through the checkout area, output the information relating to the person to the output destination device.

9 . A commodity monitoring system comprising a commodity monitoring device and an output destination device,
the commodity monitoring comprising: at least one memory configured to store instructions; and at least one processor configured to execute the instructions to; detect removal of a commodity in a quantity satisfying a predetermined condition from the commodity group area, based on image information of a commodity group area including a commodity shelf; and output, to the output destination device, change detection information including image time-series data of the commodity group area from a point in time at which the removal has been detected to a predetermined past point in time, in the case where the removal has been detected.

10 . The commodity monitoring system according to claim 9 ,
wherein the output destination device comprises a display unit configured to display any image of the image time-series data included in the change detection information based on a user operation.

11 . The commodity monitoring system according to claim 9 ,
further comprising a display device configured to display a moving image of the commodity group area from the point in time at which the removal has been detected to a predetermined past point in time.

12 . An output destination device comprising:
a change detection information acquisition unit configured to, in the case where removal of a commodity in a quantity satisfying a predetermined condition from a commodity group area set on a commodity shelf is detected, acquire change detection information including image time-series data of the commodity group area from a point in time at which the removal has been detected to a predetermined past point in time; and a display unit configured to display the image of the commodity group area included in the change detection information.

13 . (canceled)

14 . (canceled)

15 . (canceled)

16 . (canceled)

17 . The commodity monitoring device according to claim 3 ,
wherein the at least one processor is configured to acquire sales information registered in a sales information management device within a predetermined time after the removal has been detected.

18 . The commodity monitoring device according to claim 17 ,
wherein the at least one processor is configured to, in the case where sales information relating to the commodity is not acquired from the sales information management device within a predetermined time after the removal has been detected, output the change detection information not including the sales information to the output destination.

19 . The commodity monitoring device according to claim 2 ,
wherein the at least one processor is configured to, based on a past image of the commodity group area before the removal has been detected, detect information relating to a person who removed the commodity and, after outputting the change detection information to the output destination device, output the information relating to the person to the output destination device.

20 . The commodity monitoring device according to claim 3 ,
wherein the at least one processor is configured to, based on a past image of the commodity group area before the removal has been detected, detect information relating to a person who removed the commodity and, after outputting the change detection information to the output destination device, output the information relating to the person to the output destination device.

21 . The commodity monitoring device according to claim 4 ,
wherein the at least one processor is configured to, based on a past image of the commodity group area before the removal has been detected, detect information relating to a person who removed the commodity and, after outputting the change detection information to the output destination device, output the information relating to the person to the output destination device.

22 . The commodity monitoring device according to claim 19 ,
wherein the at least one processor is configured to, based on the information relating to the person who removed the commodity, determine whether the person passed the commodity through a predetermined checkout area and, in the case of having determ

Assignees

• Nec Corp

Inventors

• Nakagawa Takayuki
• Shibuya Yuma
• Tokuda Shigeaki
• Yamasaki Junpei
• Ohkubo Satoshi
• Tezuka Hiroshi
• Ikuta Nobuyuki
• Oohashi Kenichi

Classifications

• H04W4/35

  for the management of goods or merchandise · CPC title

• H04W4/021

  Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences · CPC title

• G06Q30/06

  Buying, selling or leasing transactions · CPC title

• G06Q10/087 Primary

  Inventory or stock management, e.g. order filling, procurement or balancing against orders · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title