Vehicle vision system with dirt detection

Patent metadata

Field	Value
Publication number	US-9445057-B2
Application number	US-201414183613-A
Country	US
Kind code	B2
Filing date	Feb 19, 2014
Priority date	Feb 20, 2013
Publication date	Sep 13, 2016
Grant date	Sep 13, 2016

Abstract

A vision system for a vehicle includes a camera disposed at a vehicle and having an image sensor and a lens. When the camera is disposed at the vehicle, the lens is exposed to the environment exterior the vehicle. The camera has an exterior field of view exterior the vehicle and is operable to capture image data representative of a scene occurring in the field of view of the camera. An image processor is operable to process multiple frames of image data captured by the camera, and wherein, responsive to processing multiple frames of captured image data, the image processor is operable to detect contaminants, such as water droplets or dirt, at the lens of the camera. Responsive to the image processor detecting contaminants at the lens of the camera, the vision system generates an alert and may trigger a function.

First claim

The invention claimed is:

1. A vision system for a vehicle, said vision system comprising:
a first camera disposed at a vehicle equipped with said vision system, said first camera comprising an image sensor and a lens, wherein, when said first camera is disposed at the equipped vehicle, said lens is exposed to the environment exterior the equipped vehicle;
wherein said first camera has an exterior field of view exterior the equipped vehicle and is operable to capture image data representative of a scene occurring in the field of view of said first camera;
an image processor operable to process multiple frames of image data captured by said first camera;
wherein said image processor is operable to process captured image data to detect blobs in captured image data;
wherein, responsive to processing detected blob data over multiple frames of captured image data, said image processor determines if detected blobs are representative of contaminants at said lens of said first camera;
wherein, responsive to processing a first frame of captured image data, and responsive to said image processor determining a first threshold likelihood that a detected blob is indicative of a contaminant, said image processor adjusts processing of detected blob data when processing a subsequent frame of captured image data;
wherein, responsive to said image processor determining a second threshold likelihood that the detected blob is indicative of a contaminant when processing detected blob data of said subsequent frame of captured image data, said image processor determines that the detected blob is representative of a contaminant at said lens of said first camera;
wherein, responsive to said image processor determining that the detected blob is representative of a contaminant at said lens, said vision system generates an alert;
a second camera disposed at the equipped vehicle and having a field of view that at least partially overlaps the field of view of said first camera, wherein said second camera is operable to capture image data representative of a scene occurring in the field of view of said second camera; and
wherein said image processor is operable to process image data captured by said second camera, and wherein, responsive to processing of captured image data of the overlapping portion of the fields of view of said first camera and said second camera, said image processor is operable to determine the presence of a contaminant at said lens of said first camera.

2. The vision system of claim 1 , wherein said vision system, responsive to said image processor determining that the detected blob is representative of a contaminant at said lens, triggers a function.

3. The vision system of claim 2 , wherein said function triggered by said vision system comprises cleaning of said lens of said first camera.

4. The vision system of claim 2 , wherein said function triggered by said vision system comprises an input for adjusting the processing of at least one consecutive or parallel algorithm or mode.

5. The vision system of claim 1 , wherein, responsive to determination that the detected blob is representative of a contaminant, and responsive to an exterior temperature sensor, said vision system is operable to control an HVAC system of the equipped vehicle.

6. The vision system of claim 1 , wherein said image processor is operable to adapt image processing of captured image data responsive to a determination of an environment in which the vehicle is being driven.

7. The vision system of claim 1 , wherein, after processing multiple frames of captured image data, said vision system compares a stored value to a contrast minimum value to determine if a detected blob is indicative of a contaminant at said lens.

8. The vision system of claim 1 , wherein said multiple frames of captured image data comprise at least one of (i) a difference image between two frames of captured image data, (ii) a contrast maximum image and (iii) a color space diagonal distance image.

9. The vision system of claim 1 , wherein said image processor is operable to determine contaminants comprising at least water drops and dirt at said lens of said first camera.

10. The vision system of claim 1 , wherein said first threshold likelihood is about the same as said second threshold likelihood.

11. The vision system of claim 1 , wherein said first and second threshold likelihoods comprise preselected confidence parameters of said vision system.

12. The vision system of claim 1 , wherein said first frame of captured image data is processed via a first algorithm that classifies detected blobs as possible contaminants when said image processor determines the first threshold likelihood that the detected blob is indicative of a contaminant.

13. The vision system of claim 12 , wherein said subsequent frame of captured image data is processed via a second algorithm to determine if the possible contaminant is within a threshold likelihood of being a contaminant.

14. A vision system for a vehicle, said vision system comprising:
a first camera disposed at a vehicle equipped with said vision system, said first camera comprising an image sensor and a lens, wherein, when said first camera is disposed at the equipped vehicle, said lens is exposed to the environment exterior the equipped vehicle;
wherein said first camera has an exterior field of view exterior the equipped vehicle and is operable to capture image data representative of a scene occurring in the field of view of said first camera;
an image processor operable to process multiple frames of image data captured by said first camera;
wherein said image processor is operable to process captured image data to detect blobs in captured image data;
wherein, responsive to processing detected blob data over multiple frames of captured image data, said image processor determines if detected blobs are representative of contaminants at said lens of said first camera;
wherein, responsive to processing a first frame of captured image data, and responsive to said image processor determining a first threshold likelihood that a detected blob is indicative of a contaminant, said image processor adjusts processing of detected blob data when processing a subsequent frame of captured image data;
wherein, responsive to said image processor determining a second threshold likelihood that the detected blob is indicative of a contaminant when processing detected blob data of said subsequent frame of captured image data, said image processor determines that the detected blob is representative of a contaminant at said lens of said first camera;
wherein said first and second threshold likelihoods comprise preselected confidence parameters of said vision system;
wherein said first frame of captured image data is processed via a first algorithm that classifies detected blobs as possible contaminants when said image processor determines the first threshold likelihood that the detected blob is indicative of a contaminant;
wherein said subsequent frame of captured image data is processed via a second algorithm to determine if the possible contaminant is within a threshold likelihood of being a contaminant;
wherein, responsive to said image processor determining that the detected blob is representative of a contaminant at said lens, said vision system generates an alert;
a second camera disposed at the equipped vehicle and having a field of view that at least partially overlaps the field of view of said first camera, wherein said second camera is operable to capture image data representative of a scene occurring in the field of view of said second camera; and
wherein said i

Assignees

• Magna Electronics Inc

Inventors

• May Benjamin
• May Uwe

Classifications

• H04N23/811 Primary

  by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor · CPC title

• H04N5/2171

  Electricity · mapped topic

• H04N7/18 Primary

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• G06T2207/30261

  Obstacle · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title