Vehicle vision system with lens pollution detection

Patent metadata

Field	Value
Publication number	US-9319637-B2
Application number	US-201313851378-A
Country	US
Kind code	B2
Filing date	Mar 27, 2013
Priority date	Mar 27, 2012
Publication date	Apr 19, 2016
Grant date	Apr 19, 2016

Abstract

A vision system for a vehicle includes a camera and a processor operable to process image data captured by the camera. When the vehicle is moving, the processor at least one of (a) reads a selected set of imager register values and compare a contrast of auto exposure control zones, and wherein, responsive to a determination that a range of contrast levels is less than a threshold level, the processor determines that there are contaminants at the lens or cover of the camera, and (b) monitors outputs of photosensing elements of the camera and, when the outputs fit a Gaussian distribution, the processor classifies the photosensing elements as blocked elements and, responsive to a determination that a number of the blocked photosensing elements is greater than a threshold level, the processor determines that there are contaminants at the lens or cover of the camera.

First claim

The invention claimed is:

1. A vision system for a vehicle, said vision system comprising:
a camera disposed at a vehicle and having a field of view exterior of the vehicle;
wherein said camera comprises a lens and an imaging array comprising an array of photosensing elements;
a processor operable to process image data captured by said camera;
wherein, when the vehicle is moving in a forward or rearward direction, said processor is operable to at least one of (a) read a selected set of imager register values and compare a contrast of auto exposure control zones, and wherein, responsive to a determination that a range of contrast levels is less than a threshold level, said processor determines that there are contaminants at said lens of said camera, and (b) monitor outputs of photosensing elements of said imaging array and wherein, when said photosensing element outputs fit a Gaussian distribution, said processor classifies said photosensing elements as blocked photosensing elements and, responsive to a determination that a number of said blocked photosensing elements is greater than a threshold level, said processor determines that there are contaminants at said lens of said camera; and
wherein, when said processor determines that there are contaminants at said lens of said camera, said system at least one of (i) generates an alert, (ii) adapts processing of image data to at least partially accommodate for the presence of the determined contaminants and (iii) cleans said lens.

2. The vision system of claim 1 , wherein said processor is incorporated in circuitry of said camera.

3. The vision system of claim 1 , wherein said processor is incorporated in circuitry of a control of the vehicle.

4. The vision system of claim 1 , wherein said processor is operable to read a selected set of imager register values and compare a contrast of auto exposure control zones, and wherein, responsive to a determination that a range of contrast levels is less than a threshold level, said processor determines that there are contaminants at said lens of said camera.

5. The vision system of claim 4 , wherein said processor is operable to compare a contrast of auto exposure control zones when an auto exposure function of said camera is enabled.

6. The vision system of claim 4 , wherein said processor compares contrast levels between a generally middle zone of said captured image data and a zone at an upper or lower region of said captured image data.

7. The vision system of claim 4 , wherein said processor is incorporated in circuitry of said camera.

8. The vision system of claim 1 , wherein said processor is operable to monitor outputs of photosensing elements of said imaging array and, when said photosensing element outputs fit a Gaussian distribution, said processor classifies said photosensing elements as blocked photosensing elements and, responsive to a determination that a number of said blocked photosensing elements is greater than a threshold level, said processor determines that there are contaminants at said lens of said camera.

9. The vision system of claim 8 , wherein said Gaussian distribution is based on a selected number of initial frames of said captured image data.

10. The vision system of claim 8 , wherein said processor is incorporated in circuitry of a control of the vehicle.

11. A vision system for a vehicle, said vision system comprising:
a camera disposed at a vehicle and having a field of view exterior of the vehicle;
wherein said camera comprises a lens and an imaging array comprising an array of photosensing elements;
a processor operable to process image data captured by said camera;
wherein said processor is one of (i) incorporated in circuitry of said camera and (ii) incorporated in circuitry of a control of the vehicle;
wherein, when the vehicle is moving in a forward or rearward direction, said processor is operable to read a selected set of imager register values and compare contrast levels of auto exposure control zones, and wherein, responsive to a determination that a range of contrast levels is less than a threshold level, said processor determines that there are contaminants at said lens of said camera; and
wherein, when said processor determines that there are contaminants at said lens of said camera, said system at least one of (i) generates an alert, (ii) adapts processing of image data to at least partially accommodate for the presence of the determined contaminants and (iii) cleans said lens.

12. The vision system of claim 11 , wherein said processor is operable to compare a contrast of auto exposure control zones when an auto exposure function of said camera is enabled.

13. The vision system of claim 12 , wherein said processor compares contrast levels between a generally middle zone of said captured image data and a zone at an upper or lower region of said captured image data.

14. The vision system of claim 13 , wherein said processor is incorporated in circuitry of said camera.

15. The vision system of claim 11 , wherein said processor compares contrast levels of auto exposure control zones when an auto exposure function is enabled and the equipped vehicle is moving in a forward or rearward direction to determine a determined range of contrast levels of said photosensing element outputs for at least one auto exposure control zone, and wherein, when the determined range of contrast levels of the photosensing element outputs is less than a threshold level, said processor determines that there are contaminants at said lens of said camera.

16. The vision system of claim 15 , wherein said at least one auto exposure control zone comprises a zone that is representative of a generally middle zone of captured image data that is between an upper region of captured image data and a lower region of captured image data.

17. A vision system for a vehicle, said vision system comprising:
a camera disposed at a vehicle and having a field of view exterior of the vehicle;
wherein said camera comprises a lens and an imaging array comprising an array of photosensing elements;
a processor operable to process image data captured by said camera;
wherein said processor is one of (i) incorporated in circuitry of said camera and (ii) incorporated in circuitry of a control of the vehicle;
wherein, when the vehicle is moving in a forward or rearward direction, said processor is operable to monitor outputs of photosensing elements of said imaging array and wherein, when said photosensing element outputs fit a Gaussian distribution, said processor classifies said photosensing elements as blocked photosensing elements and, responsive to a determination that a number of said blocked photosensing elements is greater than a threshold level, said processor determines that there are contaminants at said lens of said camera; and
wherein, when said processor determines that there are contaminants at said lens of said camera, said system at least one of (i) generates an alert, (ii) adapts processing of image data to at least partially accommodate for the presence of the determined contaminants and (iii) cleans said lens.

18. The vision system of claim 17 , wherein said Gaussian distribution is based on a plurality of frames of captured image data.

19. The vision system of claim 17 , wherein said Gaussian distribution is based on a selected number of initial frames of captured image data.

20. The vision system of claim 19 , wherein said processor is incorporated in circuitry of a control of the vehicle.

Assignees

• Magna Electronics Inc

Inventors

• Lu Yuesheng
• Hunt Shawn T

Classifications

• H04N23/811 Primary

  by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor · CPC title

• B60R2300/30

  characterised by the type of image processing · CPC title

• H04N7/18 Primary

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• H04N5/2171

  Electricity · mapped topic

• B60R1/00

  Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles · CPC title