Lens masking system for a vehicle

Patent metadata

Field	Value
Publication number	US-10884271-B2
Application number	US-201816018246-A
Country	US
Kind code	B2
Filing date	Jun 26, 2018
Priority date	Dec 22, 2015
Publication date	Jan 5, 2021
Grant date	Jan 5, 2021

Abstract

An image processing system for a vehicle can include a set of cameras generating image data of a surrounding environment of the vehicle, and a masking layer comprising a plurality of pixels. The system can detect, in first image data generated by the set of cameras, one or more light sources in a field of view of a respective camera of the set of cameras. The system can then activate a number of pixels of the masking layer to block each of the one or more light sources for the respective camera, preemptively bolstering a quality of second image data generated by the set of cameras while the masking layer blocks each of the one or more light sources.

First claim

What is claimed is:

1. An autonomous vehicle (AV) comprising:
a set of cameras generating image data of a surrounding environment of the AV;
a masking layer associated with each of one or more of the cameras, the masking layer comprising a plurality of pixels;
acceleration, braking, and steering systems; and
an AV control system comprising one or more processors executing instructions, causing the AV control system to:
as the AV operates along a route, detect, in first image data generated by the set of cameras, one or more light sources in a field of view of a respective camera of the set of cameras;
activate a number of pixels of the masking layer to block each of the one or more light sources for the respective camera, preemptively bolstering a quality of second image data generated by the set of cameras while the masking layer blocks each of the one or more light sources; and
autonomously operate the AV along the route based on analyzing the second image data in view of other data associated with the route.

2. The AV of claim 1 , wherein the executed instructions further cause the AV control system to track the one or more light sources in the field of view of the respective camera while autonomously operating the AV along the route.

3. The AV of claim 2 , herein the executed instructions further cause the AV control system to activate and deactivate respective pixels of the masking layer, based on tracking the one or more light sources, to continuously block each of the one or more light sources as the AV travels along the route and while the one or more light sources remain in the field of view of the respective camera.

4. The AV of claim 1 , wherein the masking layer comprises a liquid crystal display (LCD) layer.

5. The AV of claim 4 , wherein the LCD layer comprises one of a transparent passive-matrix LCD) layer or a transparent active LCD) layer.

6. The AV of claim 1 , wherein the executed instructions further cause the AV control system to:
process the second image data by comparing the second image data to stored sub-maps that provide surface data of the route; and
based on comparing the second image data with a current sub-map, autonomously operate the acceleration, braking, and steering systems along the route.

7. The AV of claim 1 , wherein the masking layer comprises a grey-scaled masking layer, and wherein the executed instructions further cause the AV control system to:
determine a brightness gradient for each light source of the one or more light sources; and
generate voltage signals that cause the masking layer to dynamically block each of the one or more light sources on a grey-scale based on the brightness gradient for the respective light source.

8. The AV of claim 1 , wherein the masking layer comprises a binary masking layer, and wherein the executed instructions further cause the AV control system to:
determine, for each light source of the one or more light sources, whether a brightness of the light source exceeds a minimum threshold brightness for triggering binary masking of the light source on the masking layer; and
dynamically block each light source of the one or more light sources based on the brightness of the respective light source exceeding the minimum threshold brightness.

9. The AV of claim 1 , wherein each of a plurality of cameras in the set of cameras comprises a respective masking layer.

10. The AV of claim 1 , wherein activation of the pixels of the masking layer further reduces processing of the image data by the AV control system.

11. An image processing system comprising:
a set of cameras generating image data of a surrounding environment of a vehicle;
a masking layer associated with each of one of more of the cameras, the masking layer comprising a plurality of pixels; and
one or more processors executing instructions, causing the one or more processors to:
as the vehicle operates along a route, detect, in first image data generated by the set of cameras, one or more light sources in a field of view of a respective camera of the set of cameras;
activate a number of pixels of the masking layer to block each of the one or more light sources for the respective camera, preemptively bolstering a quality of second image data generated by the set of cameras while the masking layer blocks each of the one or more light sources; and
autonomously operate the vehicle based on analyzing the second image data in view of other data associated with the route.

12. The image processing system of claim 11 , wherein the executed instructions further cause the one or more processors to track the one or more light sources in the field of view of the respective camera.

13. The image processing system of claim 12 , wherein the executed instructions further cause the one or more processors to activate and deactivate respective pixels of the masking layer, based on tracking the one or more light sources, to continuously block each of the one or more light sources as the vehicle travels along the route and while the one or more light sources remain in the field of view of the respective camera.

14. The image processing system of claim 11 , wherein the masking layer comprises a liquid crystal display (LCD) layer.

15. The image processing system of claim 14 , wherein the LCD layer comprises one of a transparent passive-matrix LCD layer or a transparent active LCD layer.

16. The image processing system of claim 11 , wherein the masking layer comprises a grey-scaled masking layer, and wherein the executed instructions further cause the one or more processors to:
determine a brightness gradient for each light source of the one or more light sources; and
generate voltage signals that cause the masking layer to dynamically block each of the one or more light sources on a grey-scale based on the brightness gradient for the respective light source.

17. The image processing system of claim 11 , wherein the masking layer comprises a binary masking layer, and wherein the executed instructions further cause the one or more processors to:
determine, for each light source of the one or more light sources, whether a brightness of the light source exceeds a minimum threshold brightness for triggering binary masking of the light source on the masking layer; and
dynamically block each light source of the one or more light sources based on the brightness of the respective light source exceeding the minimum threshold brightness.

18. The image processing system of claim 11 , wherein the masking layer is included as a component of the set of cameras.

19. The image processing system of claim 11 , wherein activation of the pixels of the masking layer further reduces processing of the image data by the image processing system.

20. A computer-implemented method of processing image data for a vehicle, the method being performed by one or more processors and comprising:
as the vehicle operates along a route, detecting, in first image data generated by a set of cameras, one or more light sources in a field of view of a respective camera of the set of cameras;
activating a number of pixels of a masking layer associated with the respective camera, to block each of the one or more light sources for the respective camera, preemptively bolstering a quality of second image data generated by the set of cameras while the masking layer blocks each of the one or more light sources; and
autonomously operate the vehicle based on analyzing the second image data in view of other data associated with the route

Assignees

• Uatc Llc

Inventors

• Meyhofer Eric
• Rice David

Classifications

• H04N23/57

  Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices · CPC title

• H04N23/45 Primary

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• G05D1/0251 Primary

  extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision (stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593) · CPC title

• H04N13/243

  using three or more two-dimensional [2D] image sensors · CPC title

• G02F1/13306 Primary

  Circuit arrangements or driving methods for the control of single liquid crystal cells (G02F1/132, G02F1/133382 take precedence) · CPC title