Adaptive optical attenuation in high dynamic range imaging

Patent metadata

Field	Value
Publication number	US-12526533-B2
Application number	US-202418607172-A
Country	US
Kind code	B2
Filing date	Mar 15, 2024
Priority date	Apr 13, 2023
Publication date	Jan 13, 2026
Grant date	Jan 13, 2026

Abstract

Image sensors, imaging systems, and methods for high dynamic range imaging. The image sensor includes image sensor pixels, a light filter, and a controller. The light filter is configured to attenuate transmission of incident light to the image sensor pixels. The controller is configured to set the light filter to a high-transmission state and capture a first image generated by the image sensor pixels during a first exposure. The controller is also configured to set the light filter to a low-transmission state and capture a second image generated by the image sensor pixels during a second exposure. The controller is further configured to combine the first and second images to generate a high dynamic range image. The controller is also configured to adjust an attenuation of the light filter for a next iteration of the low-transmission state based on pixel signals generated during the second exposure.

First claim

What is claimed is:

1 . An image sensor, comprising:
a plurality of image sensor pixels; a light filter configured to attenuate transmission of incident light to the plurality of image sensor pixels; and a controller configured to:
set the light filter to a high-transmission state for a first exposure,
capture a first image generated by the plurality of image sensor pixels during the first exposure,
set the light filter to a low-transmission state for a second exposure at least by setting the light filter to provide:
a first amount of attenuation to a first subset of the plurality of image sensor pixels, and
a second amount of attenuation to a second subset of the plurality of image sensor pixels,

capture a second image generated by the plurality of image sensor pixels during the second exposure,
combine the first image and the second image to generate a high dynamic range image,
adjust the first amount of attenuation of the light filter for a next iteration of the low-transmission state based on one or more first pixel signals generated by the first subset of the plurality of image sensor pixels during the second exposure, and
adjust the second amount of attenuation of the light filter for the next iteration of the low-transmission state based on one or more second pixel signals generated by the second subset of the plurality of image sensor pixels during the second exposure.

2 . The image sensor of claim 1 , wherein, to adjust the first amount of attenuation of the light filter for the next iteration of the low-transmission state, the controller is further configured to:
increase the first amount of attenuation of the light filter when a highest pixel signal of the one or more first pixel signals is greater than an upper threshold, and decrease the first amount of attenuation of the light filter when the highest pixel signal of the one or more first pixel signals is less than a lower threshold.

3 . The image sensor of claim 1 , wherein the light filter is further configured to attenuate transmission of the incident light to the first subset of the plurality of image sensor pixels based on a bias voltage, and wherein, to adjust the first amount of attenuation of the light filter for the next iteration of the low-transmission state, the controller is further configured to adjust the bias voltage.

4 . The image sensor of claim 1 , wherein, to set the light filter to the high-transmission state for the first exposure, the controller is further configured to set the light filter to provide a maximum amount of light transmission to the plurality of image sensor pixels for the first exposure.

5 . The image sensor of claim 1 , wherein the image sensor is included in at least one selected from the group consisting of an automobile, a vehicle, a camera, a cellular telephone, a tablet computing, a webcam, a video camera, a video surveillance system, and a video gaming system.

6 . The image sensor of claim 1 , wherein, to adjust the first amount of attenuation of the light filter for the next iteration of the low-transmission state, the controller is further configured to determine an adjusted first amount of attenuation based on the one or more first pixel signals, wherein the high dynamic range image is a first high dynamic range image, and wherein the controller is further configured to:
set the light filter to the high-transmission state for a third exposure, capture a third image generated by the plurality of image sensor pixels during the third exposure, set the light filter to the low-transmission state for a fourth exposure at least by setting the light filter to provide the adjusted first amount of attenuation to the first subset of the plurality of image sensor pixels, capture a fourth image generated by the plurality of image sensor pixels during the fourth exposure, and combine the third image and the fourth image to generate a second high dynamic range image.

7 . An imaging system, comprising:
an image sensor including a plurality of image sensor pixels; a light filter configured to:
attenuate transmission of incident light to the image sensor, and
individually control attenuation of the light filter provided to each of the plurality of image sensor pixels; and
an imaging controller configured to:
set the light filter to a high-transmission state for a first exposure,
capture a first image generated by the image sensor during the first exposure,
set the light filter to a low-transmission state for a second exposure,
capture a second image generated by the image sensor during the second exposure,
combine the first image and the second image to generate a high dynamic range image, and
individually adjust the attenuation of the light filter provided to each of the plurality of image sensor pixels for a next iteration of the low-transmission state based on respective pixel signals generated by each of the plurality of image sensor pixels during the second exposure.

8 . The imaging system of claim 7 , wherein, to individually adjust the attenuation of the light filter provided to each of the plurality of image sensor pixels for the next iteration of the low-transmission state, the imaging controller is further configured to:
increase the attenuation of the light filter provided to one of the plurality of image sensor pixels in the low-transmission state when a pixel signal generated by the one of the plurality of image sensor pixels during the second exposure is greater than an upper threshold, and decrease the attenuation of the light filter provided to the one of the plurality of image sensor pixels in the low-transmission state when the pixel signal generated by the one of the plurality of image sensor pixels during the second exposure is less than a lower threshold.

9 . The imaging system of claim 7 , wherein the light filter is further configured to attenuate transmission of the incident light to one of the plurality of image sensor pixels proportional to a bias voltage, and wherein, to individually adjust the attenuation of the light filter provided to each of the plurality of image sensor pixels for the next iteration of the low-transmission state, the imaging controller is further configured to adjust the bias voltage based on a pixel signal generated by the one of the plurality of image sensor pixels during the second exposure.

10 . The imaging system of claim 7 , wherein a first integration time of the first exposure is substantially equally to a second integration time of the second exposure.

11 . The imaging system of claim 7 , wherein the imaging system is included in at least one selected from the group consisting of an automobile, a vehicle, a camera, a cellular telephone, a tablet computing, a webcam, a video camera, a video surveillance system, and a video gaming system.

12 . The imaging system of claim 7 , wherein, to set the light filter to the low-transmission state for the second exposure, the imaging controller is further configured to set the light filter to provide a first amount of attenuation to one of the plurality of image sensor pixels during the second exposure, wherein, to individually adjust the attenuation of the light filter provided to each of the plurality of image sensor pixels for the next iteration of the low-transmission state, the imaging controller is further configured to determine a second amount of attenuation based on a pixel signal generated by the one of the plurality of image sensor pixels during the second exposure, wherein the high dynamic range image is a first high dynamic range image, and wherein the imaging controller is further configured to:
set the light fil

Assignees

• Semiconductor Components Ind Llc

Inventors

• Skorka Orit
• Vanhoff Barry
• Ispasoiu Radu
• Korobov Vladimir

Classifications

• H04N25/587

  acquired sequentially, e.g. using the combination of odd and even image fields · CPC title

• H04N23/745

  Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination · CPC title

• H04N23/741

  by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors · CPC title

• H04N25/585

  with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes · CPC title

• H04N23/73

  by influencing the exposure time · CPC title