Window occlusion imager near focal plane

Patent metadata

Field	Value
Publication number	US-12038540-B2
Application number	US-202318313741-A
Country	US
Kind code	B2
Filing date	May 8, 2023
Priority date	Aug 6, 2019
Publication date	Jul 16, 2024
Grant date	Jul 16, 2024

Abstract

The present disclosure relates to optical systems and methods of their operation. An example optical system includes an optical component and one or more light sources configured to emit a light signal. The light signal interacts with the optical component so as to provide an interaction light signal. The optical system also includes a detector configured to detect at least a portion of the interaction light signal as a detected light signal. The optical system additionally includes a controller configured to carry out operations including causing the one or more light sources to emit the light signal and receiving the detected light signal from the detector. The operations also include determining, based on the detected light signal, that one or more defects are associated with the optical component.

First claim

What is claimed is:

1. An optical system comprising:
an optical component;
one or more light sources configured to emit a light signal, wherein the light signal interacts with the optical component so as to provide an interaction light signal;
a defect detector configured to detect at least a portion of the interaction light signal as a detected light signal;
an optical axis;
a focal distance along the optical axis defining a focal plane;
a main image sensor arranged along the focal plane, wherein the defect detector is arranged along the focal plane; and
a controller comprising at least one processor and at least one memory, wherein the at least one processor executes instructions stored in the at least one memory so as to carry out an escalation protocol comprising:
performing a diagnostic test at repeated intervals, wherein performing the diagnostic test comprises:
causing the one or more light sources to emit the light signal; and
determining, based on a detected light signal from the defect detector, whether one or more defects are associated with the optical component;

upon determining that one or more defects are associated with the optical component:
causing a first type of corrective action to be taken; and
performing the diagnostic test again to determine whether the one or more defects are still associated with the optical component; and

upon determining that the one or more defects are still associated with the optical component, causing a second type of corrective action to be taken.

2. The optical system of claim 1 , wherein the repeated intervals are intervals of one day, one hour, one minute, thirty seconds, five seconds, one second, 500 ms, 100 ms, 50 ms, 10 ms, 5 ms, or 1 ms.

3. The optical system of claim 1 , wherein the main image sensor comprises a plurality of photodetector elements, and wherein the defect detector comprises at least a portion of the photodetector elements.

4. The optical system of claim 1 , wherein the defect detector is arranged to detect the detected light signal along a light detection axis, and wherein the light detection axis is at least 5 degrees off-axis with respect to the optical axis.

5. The optical system of claim 1 , wherein the one or more light sources comprise a light-emitting diode (LED) or a laser.

6. The optical system of claim 1 , wherein the one or more light sources are positioned adjacent to a first end of the optical component, and wherein the light signal couples into the optical component via the first end.

7. The optical system of claim 6 , wherein the defect detector is positioned at a second end of the optical component, wherein the second end is opposite the first end.

8. The optical system of claim 1 , wherein the optical component is overmolded over the one or more light sources such that the one or more light sources are at least partially embedded within the optical component.

9. The optical system of claim 1 , wherein the first type of corrective action comprises cleaning the optical component.

10. The optical system of claim 9 , wherein cleaning the optical component comprises cleaning the optical component using a windshield wiper.

11. The optical system of claim 1 , wherein the first type of corrective action comprises repairing the optical component.

12. The optical system of claim 1 , wherein the first type of corrective action comprises replacing the optical component.

13. The optical system of claim 1 , wherein the first type of corrective action comprises realigning or recalibrating the optical component.

14. The optical system of claim 1 , wherein the second type of corrective action comprises cleaning the optical component.

15. The optical system of claim 1 , wherein the second type of corrective action comprises repairing the optical component.

16. The optical system of claim 1 , wherein the second type of corrective action comprises replacing the optical component.

17. The optical system of claim 1 , wherein the second type of corrective action comprises realigning or recalibrating the optical component.

18. The optical system of claim 1 , wherein the second type of corrective action comprises decommissioning the optical component.

19. A method comprising:
causing one or more light sources to emit a light signal,
wherein the light signal interacts with an optical component of an optical system so as to provide an interaction light signal, and
wherein the optical system comprises:
an optical axis;
a focal distance along the optical axis defining a focal plane; and
a main image sensor arranged along the focal plane; and

performing a diagnostic test at repeated intervals, wherein performing the diagnostic test comprises:
causing the one or more light sources to emit the light signal; and
determining, based on a detected light signal from a defect detector arranged along the focal plane, whether one or more defects are associated with the optical component;
upon determining that one or more defects are associated with the optical component:
causing a first type of corrective action to be taken; and
performing the diagnostic test again to determine whether the one or more defects are still associated with the optical component; and

upon determining that the one or more defects are still associated with the optical component, causing a second type of corrective action to be taken.

20. A vehicle comprising:
at least one optical system, the optical system comprising:
an optical component;
one or more light sources configured to emit a light signal, wherein the light signal interacts with the optical component so as to provide an interaction light signal;
a defect detector configured to detect at least a portion of the interaction light signal as a detected light signal;
an optical axis;
a focal distance along the optical axis defining a focal plane;
a main image sensor arranged along the focal plane, wherein the defect detector is arranged along the focal plane; and
a controller comprising at least one processor and at least one memory, wherein the at least one processor executes instructions stored in the at least one memory so as to carry out an escalation protocol comprising:
performing a diagnostic test at repeated intervals, wherein performing the diagnostic test comprises:
causing the one or more light sources to emit the light signal; and
determining, based on a detected light signal from the defect detector, whether one or more defects are associated with the optical component;

upon determining that one or more defects are associated with the optical component:
causing a first type of corrective action to be taken; and
performing the diagnostic test again to determine whether the one or more defects are still associated with the optical component; and

upon determining that the one or more defects are still associated with the optical component, causing a second type of corrective action to be taken.

Assignees

• Waymo Llc

Inventors

• Shepard Ralph
• Droz Pierre-Yves
• Last Matthew
• Remesch Bryce

Classifications

• G01S17/89

  for mapping or imaging · CPC title

• G01S2007/4975

  of sensor obstruction by, e.g. dirt- or ice-coating, e.g. by reflection measurement on front-screen · CPC title

• G01S17/42

  Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46) · CPC title

• G01S17/931

  of land vehicles · CPC title

• G01S7/497 Primary

  Means for monitoring or calibrating · CPC title