Determining the transmission quality of an optical unit in a camera system

Patent metadata

Field	Value
Publication number	US-11846561-B2
Application number	US-201917416609-A
Country	US
Kind code	B2
Filing date	Nov 18, 2019
Priority date	Dec 18, 2018
Publication date	Dec 19, 2023
Grant date	Dec 19, 2023

Abstract

A method for determining the transmission quality of an optical unit in a camera system to draw conclusions about dirt and/or wear in the optical unit and particularly to determine whether the optical unit requires servicing, includes transforming spatially resolved information relating to at least one image from the camera system sectionally using a frequency transformation so that a sequence of transformation coefficients is determined for each section of the at least one image. Each transformation coefficient is a measure of the energy in a specific frequency range. At least one sequence of transformation coefficients having the highest energy values for the highest frequencies is selected. Using the at least one selected sequence a distribution of the frequencies is determined, the distribution of the frequencies is compared with a reference, and the transmission quality of the optical unit is determined using the comparison.

First claim

The invention claimed is:

1. A method for determining a transmission quality of an optical unit of a camera system, the method comprising:
transforming spatially resolved information of at least one image of the camera system section by section by using a frequency transformation, to determine a sequence of transformation coefficients for each section of the at least one image, with each respective transformation coefficient being a measure of an energy value in a specific frequency range;
selecting at least one sequence of transformation coefficients having highest energy values for highest frequencies;
determining a distribution of the frequencies by using the at least one selected sequence
comparing the distribution of the frequencies with a reference;
repeating the step of transforming spatially resolved information of at least one image of the camera system and the step of selecting the at least one sequence of transformation coefficients several times, for a plurality of images recorded within a predetermined time interval;
determining an averaged frequency distribution by using the selected sequences of the transformation coefficients; and
comparing the averaged frequency distribution with the reference, and determining the transmission quality of the optical unit by using the comparison.

2. The method according to claim 1 , which further comprises providing the spatially resolved information of the at least one image as spatially resolved brightness information.

3. The method according to claim 1 , which further comprises providing the transformation coefficients in a respective sequence each sorted in ascending order according to the frequency range.

4. The method according to claim 1 , which further comprises selecting at least one longest sequence of transformation coefficients when selecting the at least one sequence of transformation coefficients.

5. The method according to claim 1 , which further comprises determining the transmission quality of the optical unit as being inadequate, when a portion of specific high frequencies lies below a predetermined minimal value in the distribution of the frequencies.

6. The method according to claim 1 , which further comprises determining the transmission quality of the optical unit as being inadequate, when the distribution of the frequencies in relation to the reference is moved at least by a specific degree to lower frequencies.

7. The method according to claim 1 , which further comprises providing the reference as a reference distribution having been determined by using a reference image of an identical camera system, or the reference having been determined based on the reference distribution.

8. The method according to claim 1 , which further comprises using the camera system to record a plurality of images, and keeping a scene imaged by the camera system at least substantially unchanged with the recording of the plurality of images.

9. The method according to claim 1 , which further comprises:
transmitting the sequences of transformation coefficients for the sections of the at least one image within a signal from the camera system to a receiving unit;
selecting and filtering from the signal the at least one sequence of transformation coefficients to be selected; and
determining the distribution of the frequencies by using the at least one selected and filtered sequence of transformation coefficients.

10. The method according to claim 9 , which further comprises providing the signal as a compressed video stream and selecting and filtering the at least one sequence of transformation coefficients to be selected from the compressed video stream.

11. The method according to claim 1 , which further comprises determining a need to service the optical unit for at least one of cleaning, polishing or replacement of at least one optical component of the optical unit, based on the determined transmission quality.

12. The method according to claim 1 , which further comprises determining at least one of a degree of contamination or a degree of wear of a transparent protective screen of the optical unit of the camera system.

13. The method according to claim 12 , which further comprises attaching the camera system to an outside of a vehicle.

14. An evaluation unit for determining a transmission quality of an optical unit of a camera system, the evaluation unit configured:
to efficiently select at least one sequence of transformation coefficients, having highest energy values for highest frequencies, from a plurality of sequences of transformation coefficients, having been produced based on spatially resolved information of at least one image of the camera system by using a frequency transformation to determine a sequence of transformation coefficients for each section of the at least one image, with each respective transformation coefficient being a measure of an energy value in a specific frequency range;
to determine a distribution of the frequencies using the at least one selected sequence;
to compare the distribution of the frequencies with a reference;
to repeat the step of transforming spatially resolved information of at least one image of the camera system and the step of selecting the at least one sequence of transformation coefficients several times, for a plurality of images recorded within a predetermined time interval;
to determine an averaged frequency distribution by using the selected sequences of the transformation coefficients;
to compare the averaged frequency distribution with the reference; and
to determine the transmission quality of the optical unit by using the comparison.

15. The evaluation unit according to claim 14 , which further comprises a filter element configured to select and filter the at least one sequence of transformation coefficients to be selected from a compressed video stream being transmitted from the camera system to a receiving unit.

16. The evaluation unit according to claim 14 , wherein the evaluation unit is configured to determine at least one of a degree of contamination or a degree of wear of a transparent protective screen of the optical unit of the camera system.

17. The evaluation unit according to claim 16 , wherein the camera system is attached to an outside of a vehicle.

18. A system, comprising:
a camera system and an evaluation unit according to claim 14 ;
the camera system configured:
to record one or more images with spatially resolved information; and
to transform the spatially resolved information of at least one image of the camera system section by section using a frequency transformation to determine a sequence of transformation coefficients for each section of the at least one image.

19. The system according to claim 18 , wherein the camera system has an optical unit with a transparent protective screen having at least one of a degree of contamination or a degree of wear to be determined.

20. The system according to claim 19 , wherein the camera system is attached to an outside of a vehicle.

Assignees

• Siemens Mobility GmbH

Inventors

• Oertel Norbert

Classifications

• G01M11/0278 Primary

  Detecting defects of the object to be tested, e.g. scratches or dust (investigating the presence of flaws or contamination on materials by optical means G01N21/88) · CPC title

• G01M11/0285

  by measuring material or chromatic transmission properties (G01M11/0292 takes precedence) · CPC title

• G01N21/94

  Investigating contamination, e.g. dust (G01N21/85 takes precedence) · CPC title

• G06T7/0002 Primary

  Inspection of images, e.g. flaw detection · CPC title

• H04N17/002

  for television cameras · CPC title