Systems and methods for generating a high-dynamic range (HDR) pixel stream

Patent metadata

Field	Value
Publication number	US-12401911-B2
Application number	US-202418930887-A
Country	US
Kind code	B2
Filing date	Oct 29, 2024
Priority date	Nov 7, 2014
Publication date	Aug 26, 2025
Grant date	Aug 26, 2025

Abstract

A system, method, and computer program product are provided for high-dynamic range images. In use, a first pixel attribute of a first pixel is received and a second pixel attribute of a second pixel is received. Next, a scalar based on the first pixel attribute and the second pixel attribute is identified. Finally, the first pixel and the second pixel are blended, based on the scalar, wherein the first pixel is brighter than the second pixel. Additional systems, methods, and computer program products are also presented.

First claim

What is claimed is:

1. An apparatus, comprising:
an image sensor including a plurality of adjacent cells that correspond with a same color of light, the plurality of adjacent cells including: a first cell having a first photodiode generating, for a single exposure, a first analog signal, and a second cell having a second photodiode generating, for the single exposure, a second analog signal, such that at least one of the first analog signal or the second analog signal is capable of being amplified with at least one of a first gain or a second gain before being utilized to generate at least a portion of one or more line analog signals that correspond to a line of cells of the image sensor for the single exposure, where the image sensor is configured such that:
in the event that the image sensor is operating in a first mode, the first analog signal and the second analog signal are not combined for the single exposure before being utilized to generate the at least portion of the one or more line analog signals, and
in the event that the image sensor is operating in a second mode, the first analog signal is combined with the second analog signal for the single exposure before being utilized to generate the at least portion of the one or more line analog signals;

a line in communication with the plurality of adjacent cells, the line communicating the one or more line analog signals;
a first analog-to-digital channel in communication with the line, the first analog-to-digital channel capable of receiving at least one of the one or more line analog signals for conversion thereof to a first line digital signal, such that the first line digital signal is capable of being based on at least one gain;
a second analog-to-digital channel in communication with the line, the second analog-to-digital channel capable of receiving at least one of the one or more line analog signals for conversion thereof to a second line digital signal, such that the second line digital signal is capable of being based on at least one other gain; and
circuitry in communication with the first analog-to-digital channel and the second analog-to-digital channel, the circuitry capable of receiving at least one of the first line digital signal or the second line digital signal, to generate at least a portion of a first image, where the image sensor is configured such that:
in the event that the image sensor is operating in the first mode, the at least portion of the first image exhibits a first sensitivity and a first resolution, and
in the event that the image sensor is operating in the second mode, the at least portion of the first image exhibits a second sensitivity that is greater than the first sensitivity and a second resolution that is less than the first resolution.

2. The apparatus of claim 1 , wherein the apparatus is configured such that the circuitry is capable of receiving both the first line digital signal and the second line digital signal, and combining at least a portion of the first line digital signal and at least a portion of the second line digital signal, to generate the at least the portion of the first image that includes a high dynamic range (HDR) image.

3. The apparatus of claim 1 , wherein the apparatus is configured such that: the at least one of the first analog signal or the second analog signal is capable of being amplified with both the first gain and the second gain, by:
amplifying the at least one of the first analog signal or the second analog signal with the first gain before being utilized to generate at least part of a first portion of the one or more line analog signals that correspond to the line of cells for the single exposure, and, thereafter, and
amplifying the at least one of the first analog signal or the second analog signal with the second gain before being utilized to generate at least part of a second portion of the one or more line analog signals that correspond to the line of cells for the single exposure.

4. The apparatus of claim 3 , wherein the apparatus is configured such that:
the first portion of the one or more line analog signals is capable of being received by the first analog-to-digital channel after the at least one of the first analog signal or the second analog signal is amplified with the first gain, to generate the first line digital signal based on the at least one gain;
the second portion of the one or more line analog signals is capable of being received by the second analog-to-digital channel after the at least one of the first analog signal or the second analog signal is amplified with the second gain, to generate the second line digital signal based on the at least one other gain; and
the circuitry is capable of receiving both the first line digital signal and the second line digital signal, and combining at least a portion of the first line digital signal and at least a portion of the second line digital signal, to generate the at least the portion of the first image that includes a high dynamic range (HDR) image.

5. The apparatus of claim 4 , wherein the apparatus is configured such that the first gain is greater than the second gain, and the at least one gain is greater than the at least one other gain.

6. The apparatus of claim 4 , wherein the apparatus is configured such that a ratio between first gain and the second gain is the same as a ratio between the at least one gain and the at least one other gain.

7. The apparatus of claim 3 , wherein the apparatus is configured such that the at least part of the first portion of the one or more line analog signals is capable of being received by the first analog-to-digital channel after the at least one of the first analog signal or the second analog signal is amplified with the first gain to generate the first line digital signal, and the second portion of the one or more line analog signals is capable of being received by the first analog-to-digital channel after the at least one of the first analog signal or the second analog signal is amplified with the second gain to generate another first line digital signal, such that the at least portion of the first image is capable of being generated based on the first line digital signal and the another first line digital signal.

8. The apparatus of claim 7 , wherein the apparatus is configured such that the first line digital signal and the another first line digital signal are based on the at least one gain.

9. The apparatus of claim 1 , wherein the apparatus is configured such that:
the at least one of the first analog signal or the second analog signal is capable of being amplified by amplifying the at least one of the first analog signal or the second analog signal with the first gain, without being amplified with the second gain, before being utilized to generate the at least portion of the one or more line analog signals that correspond to the line of cells for the single exposure;
the one or more line analog signals is capable of being received by the first analog-to-digital channel after the at least one of the first analog signal or the second analog signal is amplified with the first gain, to generate the first line digital signal based on the at least one gain;
the one or more line analog signals is capable of being received by the second analog-to-digital channel after the at least one of the first analog signal or the second analog signal is amplified with the first gain, to generate the second line digital signal based on the at least other gain; and
the circuitry is capable of receiving both the first line digital signal and the second line digital signal, and combining at least a portion of the first line digital signal and at least a portion of the second line digital signal, to generate th

Assignees

• Duelight Llc

Inventors

• Rivard William
• Feder Adam
• Kindle Brian

Classifications

• H04N23/6811

  based on the image signal · CPC title

• H04N23/76

  by influencing the image signals · CPC title

• H04N23/72

  Combination of two or more compensation controls · CPC title

• G06T2207/20221

  Image fusion; Image merging · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title