Adhered-substance detecting apparatus and vehicle system equipped with the same

Patent metadata

Field	Value
Publication number	US-11142124-B2
Application number	US-201816635663-A
Country	US
Kind code	B2
Filing date	Jul 27, 2018
Priority date	Aug 2, 2017
Publication date	Oct 12, 2021
Grant date	Oct 12, 2021

Abstract

An adhered-substance detecting apparatus capable of detecting adhered substances such as water droplets, mud, and dust, including those with ambiguous outlines, which adhere to, for example, a lens for an imaging apparatus, and a vehicle system equipped with the adhered-substance detecting apparatus are provided.

First claim

What is claimed is:

1. An adhered-substance detecting apparatus for detecting an adhered substance appearing in a captured image photographed by an imaging apparatus installed at a moving body, the adhered-substance detecting apparatus comprising:
an outline extraction unit that extracts an area of an outline of the adhered substance from the captured image as an outline area;
an inside extraction unit that extracts an area being inside the outline of the adhered substance from the captured image as an inside area;
an adhered-substance-detected area judgment unit that:
compares the outline area with an outline of a first predetermined adhered substance and detects the outline area with either one of matching shape and matching luminance as an adhered substance outline area,
compares the inside area with an area being inside an outline of a second predetermined adhered substance and detects the inside area with either one of matching shape and matching luminance as an adhered substance inside area, and
detects an area of the adhered substance, which is composed of either one of an outline of an adhered substance and an area being inside an outline of an adhered substance, as an adhered-substance-detected area from either one of the adhered substance outline area and the adhered substance inside area.

2. The adhered-substance detecting apparatus according to claim 1 ,
wherein the outline extraction unit extracts an edge area with a specified range of edge intensity from the captured image as the outline area; and the inside extraction unit extracts either one of a weaker edge area than the outline area and an area with no edge intensity, as the inside area, from the captured image.

3. The adhered-substance detecting apparatus according to claim 1 , further comprising a lens condition judgment unit that judges dirtiness of a lens for the imaging apparatus on the basis of the adhered-substance-detected area.

4. The adhered-substance detecting apparatus according to claim 3 ,
wherein the lens condition judgment unit changes a size of an index indicating the dirtiness of the lens according to a position of the adhered-substance-detected area.

5. The adhered-substance detecting apparatus according to claim 1 ,
wherein the adhered-substance-detected area judgment unit excludes an area which is the inside area and which does not have the outline of the adhered substance as its outside, from the adhered substance inside area.

6. The adhered-substance detecting apparatus according to claim 5 ,
wherein the adhered-substance-detected area judgment unit does not exclude the inside area having a weak outline area as its outside, which is obtained when the outline extraction unit relaxes an extraction condition than an extraction condition to extract the outline area, from the adhered substance inside area.

7. The adhered-substance detecting apparatus according to claim 1 ,
wherein the adhered-substance-detected area judgment unit detects the adhered substance outline area and the adhered substance inside area together as the adhered-substance-detected area.

8. The adhered-substance detecting apparatus according to claim 1 ,
wherein the adhered-substance-detected area judgment unit detects the adhered substance outline area and the adhered substance inside area, which are adjacent to each other, as the adhered-substance-detected area.

9. The adhered-substance detecting apparatus according to claim 1 , further comprising an adhered-substance-detected area tracking unit for tracking the adhered-substance-detected area.

10. The adhered-substance detecting apparatus according to claim 9 ,
wherein regarding the adhered substance inside area detected by the adhered-substance-detected area judgment unit in the past, either one of the outline area and the adhered substance outline area is treated as either one of the inside area and the adhered substance inside area.

11. The adhered-substance detecting apparatus according to claim 9 ,
wherein by referring to either one of the adhered substance outline area and the adhered substance inside area which were detected by the adhered-substance-detected area judgment unit in the past, or the adhered-substance-detected area, either one of the outline extraction unit and the inside extraction unit relaxes an extraction condition of either one of the outline area and the inside area with respect to an image area including the above-described area.

12. A vehicle system comprising:
the adhered-substance detecting apparatus stated in claim 1 ;
the imaging apparatus that is mounted in a vehicle and captures images of surroundings of the vehicle; and
an ambient sensing unit that changes operation on the basis of the adhered-substance-detected area detected by the adhered-substance-detected area judgment unit and detects an object and/or a sign regarding a captured image photographed by the imaging apparatus.

Assignees

• Clarion Co Ltd

Inventors

• Mandai Kohei
• Ogata Takehito
• Fukuda Daisuke
• Kaneko Shuzo

Classifications

• G06T7/12 Primary

  Edge-based segmentation · CPC title

• H04N23/811

  by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N23/955

  for lensless imaging · CPC title