Image processing device, image processing system, image processing method, and computer program product

Patent metadata

Field	Value
Publication number	US-10873719-B2
Application number	US-201715665459-A
Country	US
Kind code	B2
Filing date	Aug 1, 2017
Priority date	Feb 5, 2015
Publication date	Dec 22, 2020
Grant date	Dec 22, 2020

Abstract

An image processing device includes a display device, a video display controller configured to display video data imaged by an imaging device in a predetermined display region to be displayed by the display device, and a region display controller configured to display a plurality of display elements representing determination regions based on a plurality of types of determination functions with respect to the video data in the display region by superimposing the plurality of display elements on the video data in aspects different from each other.

First claim

What is claimed is:

1. An image processing device, comprising:
a display device; and
processing circuitry configured to
display real-time video data imaged by an imaging device in a predetermined display region to be displayed by the display device,
designate a first determination region and a second determination region according to a user operation, the first determination region being a target of a first determination function for performing a first determination with respect to the video data, the second determination region being a target of a second determination function for performing a second determination with respect to the video data, both the first determination region and the second determination region being fixed regions, the first determination function being different from the second determination function, and
display a display element representing the first determination region and a display element representing the second determination region in the display region by superimposing the elements on the video data in aspects different from each other,

wherein the processing circuitry displays, as one of the determination regions, a display element of a trigger region, which is a portion of the displayed real-time video data imaged by the imaging device, for generating a trigger on the basis of a comparison result of an image currently displayed within the trigger region with respect to a first standard image, and display elements of a plurality of detection regions as a plurality of the determination regions that are portions of the displayed real-time video data imaged by the image device and that are separate from the trigger region, for performing image determination of whether or not there is an abnormality by an image currently displayed within each respective detection region being compared with each of one or more second standard images before a predetermined time or after the predetermined time on the basis of a timing of the trigger, on each of the display regions, and
the processing circuitry is further configured to
compare an image in the trigger region with the first standard image, to generate a trigger signal on the basis of the comparison result, and
compare features in an image in each of the detection regions with features in a corresponding second standard image of the one or more second standard images at a time point, to determine whether or not there is the abnormality based on a threshold corresponding to a similarity or difference between the compared features being exceeded, the time point being set in advance for each of the one or more detection regions, to be earlier or later than when the trigger signal is generated, by a predetermined time,

wherein
for at least one of the detection regions, the time point is set to be earlier than when the trigger signal is generated, and
for at least another of the detection regions, the time point is set to be later than when the trigger signal is generated.

2. The image processing device according to claim 1 ,
wherein the processing circuitry displays at least any one of the display elements of each of the determination regions as frames surrounding the determination regions of colors different from each other.

3. The image processing device according to claim 1 ,
wherein the processing circuitry changes an aspect of the display element in a case where a predetermined state is detected in the determination region to an aspect of the display element in a case where the predetermined state is not detected in the determination region, with respect to at least any one of the display elements of each of the determination regions, and displays the changed aspect.

4. The image processing device according to claim 1 , further comprising:
a memory configured to store the video data imaged by the imaging device; and
the processing circuitry is configured to cause the memory to store information of a date in which each of the determination regions is designated and information of a date in which the predetermined state is detected in each of the determination regions,
wherein the processing circuitry reproduces and displays the video data stored in the storage in the display region, and
the processing circuitry displays the display elements representing each of the determination regions in the display region, according to the information of the date stored in the memory.

5. The image processing device according to claim 4 , wherein the processing circuitry is configured to display a detection date of at least any one of the predetermined states detected in each of the determination regions in a list, on the basis of the information of the date stored in the memory.

6. The image processing device according to claim 1 ,
wherein the processing circuitry displays the video data imaged by the plurality of imaging devices in the display region.

7. The image processing device according to claim 1 ,
wherein the processing circuitry continues display of each of the display elements representing a determination result of the image determination in each of one or more detection regions until at least all of the image determinations of one or more detection regions associated with the trigger region are ended.

8. The image processing device according to claim 1 , wherein the processing circuitry is configured to output sound representing determination end when the image determination in a final detection region of the detection regions associated with the trigger region is ended.

9. The image processing device according to claim 1 , wherein the processing circuitry is configured to output sound representing occurrence of an abnormality when the abnormality is detected in the detection region.

10. An image processing system, comprising:
the image processing device according to claim 1 ; and
one or more imaging devices.

11. An image processing method, comprising:
displaying real-time video data imaged by an imaging device in a predetermined display region to be displayed by a display device;
designating a first determination region and a second determination region according to a user operation, the first determination region being a target of a first determination function for performing a first determination with respect to the video data, the second determination region being a target of a second determination function for performing a second determination with respect to the video data, both the first determination region and the second determination region being fixed regions, the first determination function being different from the second determination function; and
displaying a display element representing the first determination region and a display element representing the second determination region in the display region by superimposing the elements on the video data in aspects different from each other,
wherein the method includes displaying, as one of the determination regions, a display element of a trigger region, which is a portion of the displayed real-time video data imaged by the imaging device, for generating a trigger on the basis of a comparison result of an image currently displayed within the trigger region with respect to a first standard image, and displaying elements of a plurality of detection regions as a plurality of the determination regions that are portions of the displayed real-time video data imaged by the image device and that are separate from the trigger region, for performing image determination of whether or not there is an abnormality by an image currently displayed within each respective detection region being compared with each of one or more second standard images be

Assignees

• Ohmura Keiji
• Hasegawa Takeshi
• Ricoh Co Ltd

Inventors

• Ohmura Keiji
• Hasegawa Takeshi

Classifications

• G06V10/945

  User interactive design; Environments; Toolboxes · CPC title

• H04N5/44504 Primary

  Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits · CPC title

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title

• G06F18/40

  Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title