Intra-facility activity analysis device, intra-facility activity analysis system, and intra-facility activity analysis method

Patent metadata

Field	Value
Publication number	US-10796138-B2
Application number	US-201716086499-A
Country	US
Kind code	B2
Filing date	Feb 15, 2017
Priority date	Mar 31, 2016
Publication date	Oct 6, 2020
Grant date	Oct 6, 2020

Abstract

Activity information acquirer that acquires activity information representing an activity level of a moving object for each of a plurality of predetermined detection elements acquired through division performed on a captured image, a target area setter that sets a target area on a facility map image acquired by drawing a layout on the inside of the facility, an indexed information generator that generates indexed information acquired by indexing the activity state of the moving object in the target area on the basis of the activity information, an activity state display image generator that generates a digest image representing an overall activity state of the moving object in the target area on the basis of the indexed information, and an output information generator that generates output information which includes display information acquired by superimposing an activity state display image on the facility map image.

First claim

The invention claimed is:

1. An intra-facility activity analysis device, which performs analysis relevant to an activity state of a moving object on the basis of activity information generated from a captured image acquired by imaging an inside of a facility, and generates output information acquired by visualizing the activity state of the moving object, the intra-facility activity analysis device comprising:
a processor; and
a memory that stores an instruction,
wherein the processor, when executing the instruction stored in the memory, performs operations including:
acquiring the activity information representing an activity level of the moving object for each of a plurality of predetermined detection elements acquired through division performed on the captured image;
setting a target area on a facility map image acquired by drawing a layout on the inside of the facility;
generating indexed information of the target area, acquired by integrating the activity state of the moving object in the target area on the basis of the activity information for the plurality of predetermined detecting elements in the target area;
generating an activity state display image representing overall activity state of the moving object in the target area on the basis of the indexed information;
generating the output information which includes first display information acquired by superimposing the activity state display image on the facility map image;
displaying the generated first display information, on a display;
receiving an operation for designating densification of the activity state display image by a user, while the first display information is displayed on the display;
in response to receiving the operation for designating densification while the first display information is displayed on the display, generating a densified activity state display image representing the activity state of the moving object in each of the plurality of predetermined detecting elements on the inside of the target area on the basis of the activity information for each of the plurality of predetermined detecting elements in the target area;
generating the output information including second display information acquired by superimposing the densified activity state display image on the facility map image; and
switching an image displayed on the display from the first display information to the generated second display information.

2. The intra-facility activity analysis device of claim 1 ,
wherein the target area is set in an arbitrary shape designated by the user according to an input operation of the user.

3. The intra-facility activity analysis device of claim 1 ,
wherein the activity information is related to at least any one of the number of staying people, which is the number of people who stay in the target area, and stay time which is time during which a person stays in the target area.

4. The intra-facility activity analysis device of claim 1 ,
wherein the output information relevant to an activity state display screen is generated that includes a map display unit, which displays the activity state display image superimposed on the facility map image and an operation unit, which causes the user to designate an observation period of the activity information, and
wherein the activity information which is generated during the observation period designated by the user is acquired.

5. The intra-facility activity analysis device of claim 1 , wherein the processor, when executing the instruction stored in the memory, further performs operations including:
generating statistical information relevant to a state on the inside of the facility,
wherein the output information is generated that includes the first display information, which is acquired by superimposing the activity state display image on the facility map image, and relevant display information which causes the statistical information relevant to the activity state display image to be displayed as relevant information.

6. The intra-facility activity analysis device of claim 5 ,
wherein the output information relevant to an activity state display screen is generated that includes a map display unit, which displays the activity state display image superimposed on the facility map image, and a selector, which causes a display item of the relevant information to be selected, and
in response to receiving an operation for selecting the display item in the selector by the user, the output information relevant to a relevant information display screen that displays the relevant information of the selected display item is generated.

7. The intra-facility activity analysis device of claim 1 , wherein the processor, when executing the instruction stored in the memory, further performs operations including:
acquiring a camera image acquired by imaging the inside of the facility,
wherein display information is generated in which a plurality of the camera images relevant to the target area are disposed in time series.

8. The intra-facility activity analysis device of claim 7 ,
wherein the output information relevant to a relevant information display screen, which displays the plurality of camera images disposed in time series to be selectable, is generated, and
in response to receiving an operation for selecting a camera image on the relevant information display screen by the user, the selected camera image on the relevant information display screen is enlarged and displayed.

9. The intra-facility activity analysis device of claim 1 , wherein the processor, executing the instruction stored in the memory, further performs operations including:
determining a merchandise exhibition state in an exhibition area relevant to the target area in a store as the facility on the basis of a camera image,
wherein display information which displays a graph representing the merchandise exhibition state in the exhibition area is generated on the basis of a result of the determining of the merchandize exhibition state.

10. The intra-facility activity analysis device of claim 9 ,
wherein the display information displays the graph representing the merchandise exhibition state in the exhibition area and the camera image relevant to the target area in parallel.

11. The intra-facility activity analysis device of claim 1 , wherein
in the activity state display image, the target area is entirely filled with a single color, a single pattern or a single contrasting density corresponding to the indexed information of the target area, and
in the densified activity state display image, the target area is filled with a plurality of colors, a plurality of patterns, or a plurality of contrasting densities, so that each of the plurality of predetermined detecting elements in the target area is filled with a color, a pattern or a contrasting density corresponding to the activity state of the moving object in the predetermined determined element.

12. An intra-facility activity analysis system, which performs analysis relevant to an activity state of a moving object on the basis of activity information generated from a captured image acquired by imaging an inside of a facility, and generates output information acquired by visualizing the activity state of the moving object, the intra-facility activity analysis system comprising:
a camera that images the inside of the facility, generates the activity information representing an activity level of the moving object for each of a plurality of predetermined detection elements acquired through division performed on the captured image, and outputs the activity information;
a server device that generates the output infor

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Takemoto Yuichiro
• Fukatsu Takashi
• Uno Yoshinobu

Classifications

• G06Q10/063 Primary

  Operations research, analysis or management · CPC title

• G06V40/103

  Static body considered as a whole, e.g. static pedestrian or occupant recognition · CPC title

• G06V40/20 Primary

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06V20/53

  Recognition of crowd images, e.g. recognition of crowd congestion · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title