Failure detection apparatus and failure detection program

Patent metadata

Field	Value
Publication number	US-9769469-B2
Application number	US-201514789536-A
Country	US
Kind code	B2
Filing date	Jul 1, 2015
Priority date	Jul 2, 2014
Publication date	Sep 19, 2017
Grant date	Sep 19, 2017

Abstract

In a failure detecting apparatus, acquiring unit acquires a plurality of images captured by a plurality of imaging devices in which exposures thereof are capable of being individually controlled. The plurality of images including an overlapped region that represents a region where images are overlapped. The region extracting unit extracts a plurality of overlapped regions from the plurality of images acquired by the acquiring unit. The feature extracting unit extracts features of image from the plurality of overlapped regions extracted by the region extracting unit. Further, the comparing unit compares the features of image between the plurality of overlapped regions and the similarity determining unit determines whether or not the features of image are similar based on a result of comparing by the comparing unit. The failure determining unit determines a failure in the imaging device when the similarity determining unit determines the features of image are not similar.

First claim

What is claimed is:

1. A failure detecting apparatus that detects failure of an imaging device comprising:
acquiring means for acquiring a plurality of images captured by a plurality of imaging devices in which exposures thereof are capable of being individually controlled, the plurality of images including an overlapped region that represents a region where images are overlapped;
region extracting means for extracting a plurality of overlapped regions from the plurality of images acquired by the acquiring means;
feature extracting means for extracting features of image from the plurality of overlapped regions extracted by the region extracting means;
comparing means for comparing the features of image between the plurality of overlapped regions;
similarity determining means for determining whether or not the features of image are similar based on a result of comparing by the comparing means; and
failure determining means for determining a failure in the imaging device when the similarity determining means determines the features of image are not similar.

2. The failure detecting apparatus according to claim 1 , wherein
the feature extracting means is configured to generate histograms for every overlapped region, based on luminance or color of respective pixels that constitute the plurality of overlapped regions and compare histograms among a plurality of histograms, thereby determining whether or not features of images are similar.

3. The failure detecting apparatus according to claim 1 ,
wherein
the plurality of imaging devices is configured to output, when receiving a test output signal from an external device, a test image which is prepared in advance instead of the captured images; and
the failure determining means is configured to transmit the test output signal to each of the plurality of imaging devices, determine whether or not the test image outputted from the plurality of imaging devices is normal and determine that an imaging device that outputs abnormal test image has a failure.

4. The failure detecting apparatus according to claim 1 ,
wherein
the failure detecting apparatus includes luminance acquiring means for acquiring luminance surrounding the imaging device; and
the failure determining means is configured to compare respective actual luminance values at the plurality of overlapped regions with a reference luminance value at an overlapped region based on a luminance prepared in advance, when features of image is not similar and determine that an imaging device having actual luminance value which is far from the reference luminance value has a failure.

5. The failure detecting apparatus according to claim 1 ,
wherein
the failure detecting apparatus is mounted on a vehicle and includes wiper state acquiring means for acquiring an operational state of the wiper; and
the region extracting means is configured to extract the overlapped region from acquired images in which the wiper is not included.

6. The failure detecting apparatus according to claim 1 ,
wherein
the acquiring means is configured to repeatedly acquire a plurality of images;
the region extracting means, the feature extracting means and
the similarity determining means are configured to extract respective overlapped regions and features of images in the plurality of images repeatedly acquired, and determine whether or not the features of the images are similar; and
the failure determining means is configured to determine that failure has occurred in the imaging device, when determining for plural times that features of plurality of images repeatedly acquired are not similar.

7. The failure detecting apparatus according to claim 1 ,
wherein the failure detecting apparatus includes failsafe means for making an application that uses the captured image to perform a failsafe process set in advance, when failure in the imaging device is determined.

8. The failure detecting apparatus according to claim 7 , wherein
the failsafe means is configured to execute, as a failsafe process, a process without using an imaging device in which failure has occurred.

9. The failure detecting apparatus according to claim 7 , wherein
the failure detecting apparatus includes exposure controlling means for controlling a plurality of imaging devices to capture images with the same exposure condition; and
the acquiring means is configured to acquire a plurality of images captured with the same exposure condition.

10. A system for detecting failure of an imaging device comprising:
a central processor;
a computer-readable storage medium; and
a set of computer-executable instructions stored on the computer-readable storage medium that cause the central processor to implement:
acquiring a plurality of images captured by a plurality of imaging devices in which exposures thereof are capable of being individually controlled, the plurality of images including an overlapped region that represents a region where images are overlapped;
extracting a plurality of overlapped regions from the plurality of images acquired;
extracting features of image from the plurality of overlapped regions extracted;
comparing the features of image between the plurality of overlapped regions;
determining whether or not the features of image are similar based on a result of comparing; and
determining a failure in the imaging device when the features of image are not similar.

11. A method for detecting failure of an imaging device comprising:
acquiring a plurality of images captured by a plurality of imaging devices in which exposures thereof are capable of being individually controlled, the plurality of images including an overlapped region that represents a region where images are overlapped;
extracting a plurality of overlapped regions from the plurality of images acquired;
extracting features of image from the plurality of overlapped regions extracted, wherein extracting features of image from the plurality of overlapped regions extracted further comprises: generating histograms for every overlapped region, based on luminance or color of respective pixels that constitute the plurality of overlapped regions and comparing histograms among a plurality of histograms, thereby determining whether or not features of images are similar;
comparing the features of image between the plurality of overlapped regions;
determining whether or not the features of image are similar based on a result of the comparing; and
determining a failure in the imaging device when the features of image are not similar.

12. The method for detecting failure of an imaging device according to claim 11 , further comprising:
outputting, when receiving a test output signal from an external device, a test image from the plurality of imaging devices which is prepared in advance instead of the captured images; and
transmitting the test output signal to each of the plurality of imaging devices, determining whether or not the test image outputted from the plurality of imaging devices is normal and determining that an imaging device that outputs abnormal test image has a failure.

13. The method for detecting failure of an imaging device according to claim 11 , further comprising:
acquiring luminance surrounding the imaging device; and
comparing respective actual luminance values at the plurality of overlapped regions with a reference luminance value at an overlapped region based on a luminance prepared in advance, when features of image is not similar and determine that an imaging device having actual luminance value which is far from the reference luminance value has a failure.

14. The meth

Assignees

• Denso Corp

Inventors

• Ooi Takashi

Classifications

• G06V10/16

  using multiple overlapping images; Image stitching · CPC title

• G06T2207/30252

  Vehicle exterior; Vicinity of vehicle · CPC title

• G06T2207/10021

  Stereoscopic video; Stereoscopic image sequence · CPC title

• G06T2207/10012

  Stereo images · CPC title

• G06T2207/30168

  Image quality inspection · CPC title