Surveillance terminal apparatus, surveillance system, and non-transitory computer-readable recording medium having surveillance display control program recorded thereon

Patent metadata

Field	Value
Publication number	US-10783761-B2
Application number	US-201916237992-A
Country	US
Kind code	B2
Filing date	Jan 2, 2019
Priority date	Jan 12, 2018
Publication date	Sep 22, 2020
Grant date	Sep 22, 2020

Abstract

A surveillance terminal apparatus includes a storage unit, a communication unit, a picture identifier, a reader, a facial recognition processor, a display unit, and a playback controller. The picture identifier identifies, as an entry picture and an exit picture, a part of the picture of a target person shot by an imaging device and stored in the storage unit. The facial recognition processor identifies both of the entry picture and the exit picture of the same target person, by performing facial recognition with respect to the entry picture and the exit picture read out by the reader. The playback controller changes playback times of the pictures corresponding to actual length of the pictures to the same playback time, when a difference between the playback times of the respective pictures exceeds a threshold, and causes the display unit to simultaneously play back both of the pictures side by side.

First claim

What is claimed is:

1. A surveillance terminal apparatus comprising:
a storage unit that stores therein a picture of a gate through which a target person passes when entering or exiting, the picture having been shot by an imaging device;
a communication unit that receives output information from an entry/exit detection device that detects entry and exit of the target person;
a display unit; and
a control unit that includes a processor and acts, when the processor executes a control program, as:
a picture identifier that identifies, as an entry picture, a part of the picture stored in the storage unit representing the target person included in an entry detection section, the target person being identified on a basis of output information from an entry/exit detection device that detects entry and exit of the target person, and identifies, as an exit picture, a part of the picture stored in the storage unit representing the target person included in an exit detection section, the target person being identified on a basis of the output information from the entry/exit detection device received by the communication unit;
a reader that reads out the entry picture and the exit picture identified by the picture identifier, from the storage unit;
a facial recognition processor that identifies both of the entry picture and the exit picture of the same target person, by performing facial recognition with respect to the entry picture and the exit picture read out by the reader;
a gate-pass time calculator that respectively calculates a gate-pass time for entry of the target person and a gate-pass time for exit of the target person, the gate-pass time for entry being equal to an actual length of the entry picture in both of the pictures identified by the facial recognition processor, and the gate-pass time for exit being equal to an actual length of the exit picture in both of the pictures; and
a playback controller that decides whether a difference between the gate-pass time for entry and the gate-pass time for exit exceeds a threshold, when deciding that the difference exceeds the threshold, by decreasing playback speed of a picture, being one of both of the pictures and having shorter playback time, to be slower than normal speed so as to extend the playback time of the picture having shorter playback time to a changed playback time and by increasing playback speed of a picture, being one of both of the pictures and having longer playback time, to be faster than the normal speed so as to shorten the playback time of the picture having longer playback time to the changed playback time, changes playback times of the respective pictures to the same changed playback time, and causes the display unit to start simultaneously playing back both of the pictures side by side, to thereby cause both of the pictures to be simultaneously played back at the same changed playback time.

2. The surveillance terminal apparatus according to claim 1 , wherein
when the processor executes the control program, the control unit further acts as:
a picture decider that decides whether at least one of the pictures identified by the facial recognition processor includes a specific picture content, through an image analysis process,
when the picture decider decides that the specific picture content is not included, by decreasing playback speed of a picture, being one of both of the pictures and having shorter playback time, to be slower than the normal speed so as to extend the playback time of the picture having shorter playback time to a first playback time that has been changed and by increasing playback speed of a picture, being one of both of the pictures and having longer playback time, to be faster than the normal speed so as to shorten the playback time of the picture having longer playback time to the first playback time that has been changed, the playback controller changes the playback times of the respective pictures to the same first playback time that has been changed, and causes the display unit to start simultaneously playing back both of the pictures side by side, to thereby cause both of the pictures to be simultaneously played back at the same first playback time that has been changed, and when the picture decider decides that the specific picture content is included, by decreasing playback speed of a picture, being one of both of the pictures and having shorter playback time, to be slower than the normal speed so as to extend the playback time of the picture having shorter playback time to a second playback time that has been changed, the second playback time being longer than the first playback time, and by increasing playback speed of a picture, being one of both of the pictures and having longer playback time, to be faster than the normal speed so as to shorten the playback time of the picture having longer playback time to the second playback time that has been changed, the playback controller changes the playback times of the respective pictures to the same second playback time that has been changed, and causes the display unit to start simultaneously playing back both of the pictures side by side, to thereby cause both of the pictures to be simultaneously played back at the same second playback time that has been changed.

3. The surveillance terminal apparatus according to claim 1 , wherein
when the processor executes the control program, the control unit further acts as:
a storage format setter that determines whether to store both of the pictures identified by the facial recognition processor in the storage unit, with the playback time that has been changed.

4. The surveillance terminal apparatus according to claim 1 ,
wherein the facial recognition processor decides whether a plurality of target persons are included in the entry picture, by performing facial recognition with respect to the entry picture and the exit picture read out by the reader, identifies the entry picture including a plurality of target persons as a multiple entry picture, and identifies, as a related exit picture, the exit picture including at least one of the plurality of target persons in the multiple entry picture, and
when a difference in playback time corresponding to an actual length between the multiple entry picture and the related exit picture identified by the facial recognition processor exceeds a threshold, the playback controller, by decreasing playback speed of a picture, being one of both of the pictures and having shorter playback time, to be slower than the normal speed so as to extend the playback time of the picture having shorter playback time to the changed playback time and by increasing playback speed of a picture, being one of both of the pictures and having longer playback time, to be faster than the normal speed so as to shorten the playback time of the picture having longer playback time to the changed playback time, changes the playback times of the respective pictures to the same changed playback time, and causes the display unit to start simultaneously playing back both of the pictures side by side, to thereby cause both of the pictures to be simultaneously played back at the same changed playback time.

5. The surveillance terminal apparatus according to claim 4 ,
wherein the facial recognition processor identifies, as a succeeding related exit picture, the exit picture including the target person among the plurality of target persons in the multiple entry picture, other than the target persons in the related exit picture, and shot later than the related exit picture, and
when causing the display unit to display the multiple entry picture and the succeeding related exit picture, the playback controller causes the display unit to display an image of the target person among the plurality of persons in the multiple entry pictur

Assignees

• Kyocera Document Solutions Inc

Inventors

• Sakashita Fumiya
• Hiranuma Yoichi
• Sakaguchi Shoichi
• Fujiwara Shohei

Classifications

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G11B27/28

  by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} · CPC title

• G11B27/005

  Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783) · CPC title