Systems and methods for generating a high-dynamic range (hdr) pixel stream

Patent metadata

Field	Value
Publication number	US-2025056131-A1
Application number	US-202418930887-A
Country	US
Kind code	A1
Filing date	Oct 29, 2024
Priority date	Nov 7, 2014
Publication date	Feb 13, 2025
Grant date	—

Abstract

A system, method, and computer program product are provided for high-dynamic range images. In use, a first pixel attribute of a first pixel is received and a second pixel attribute of a second pixel is received. Next, a scalar based on the first pixel attribute and the second pixel attribute is identified. Finally, the first pixel and the second pixel are blended, based on the scalar, wherein the first pixel is brighter than the second pixel. Additional systems, methods, and computer program products are also presented.

First claim

1 .- 20 . (canceled)

21 . An apparatus, comprising:
an image sensor including a plurality of cells including a first cell that has a first photodiode that generates a first analog signal which is amplified with a first gain, and a second cell that is adjacent to the first cell and that has a second photodiode that generates a second analog signal which is amplified with a second gain, such that the first gain-amplified first analog signal and the second gain-amplified second analog signal are simultaneously generated for a same single exposure, and the first gain-amplified first analog signal and the second gain-amplified second analog signal are part of a line analog signal generated for the same single exposure that corresponds to a line of the plurality of cells; a first amplifier receiving the line analog signal to apply a third gain thereto for generating a third gain-amplified line analog signal; a first analog-to-digital converter in communication with the first amplifier, the first analog-to-digital converter receiving the third gain-amplified line analog signal for conversion thereof to a third gain-amplified line digital signal; a second amplifier receiving the line analog signal to apply a fourth gain thereto for generating a fourth gain-amplified line analog signal; a second analog-to-digital converter in communication with the second amplifier, the second analog-to-digital converter receiving the fourth gain-amplified line analog signal for conversion thereof to a fourth gain-amplified line digital signal; and at least one circuitry in communication with the first analog-to-digital converter and the second analog-to-digital converter, the at least one circuitry receiving the third gain-amplified line digital signal and the fourth gain-amplified line digital signal, to combine at least a portion of the third gain-amplified line digital signal and at least a portion of the fourth gain-amplified line digital signal, resulting in at least a portion of a first high dynamic range (HDR) image.

22 . The apparatus of claim 21 , wherein the apparatus is configured such that the at least one circuitry is a component of the image sensor.

23 . The apparatus of claim 21 , wherein the apparatus is configured such that the image sensor, the first amplifier, the first analog-to-digital converter, the second amplifier, the second analog-to-digital converter, and the at least one circuitry are integrated in a single-package integrated system.

24 . The apparatus of claim 21 , wherein the apparatus is configured such that the image sensor, the first amplifier, and the second amplifier are integrated in a single integrated circuit.

25 . The apparatus of claim 21 , wherein the apparatus is configured such that different adjacent cells of the image sensor are associated with a same pixel, correspond with a same color of light, and are subject to:
for the first HDR image, a first sampling during which one or more analog signals generated by each of the different adjacent cells corresponding with the same color of light are sampled and combined, and for a second HDR image, a second sampling during which one or more analog signals generated by only a subset of the different adjacent cells corresponding with the same color of light are sampled without being combined with any analog signal generated by any other of the different adjacent cells corresponding with the same color of light.

26 . The apparatus of claim 25 , wherein the apparatus is configured such that the at least portion of the first HDR image is combined with the at least portion of the second HDR image.

27 . The apparatus of claim 21 , wherein the apparatus is configured such that the first and second cells of the image sensor correspond with a same color of light, and are subject to:
for the first HDR image, a first sampling during which the at first analog signal and the second analog signal generated by the first and second cells corresponding with the same color of light are sampled and combined before the line analog signal is generated; and for a second HDR image, a second sampling during which only one of the first analog signal or the second analog signal is sampled without being combined before the line analog signal is generated.

28 . The apparatus of claim 27 , wherein the apparatus is configured such that the at least portion of the first HDR image is combined with the at least portion of the second HDR image.

29 . The apparatus of claim 27 , wherein the apparatus is configured such that the at least portion of the first HDR image that results from the first sampling is sampled with a first exposure time, and at least a portion of the second HDR image that results from the second sampling is sampled with a second exposure time.

30 . The apparatus of claim 29 , wherein the apparatus is configured such that the at least portion of the first HDR image is combined with the at least portion of the second HDR image.

31 . The apparatus of claim 29 , wherein the apparatus is configured such that the first HDR image is sampled with a greater sensitivity and a lower resolution as compared to the manner in which the second HDR image is sampled.

32 . The apparatus of claim 29 , wherein the apparatus is configured such that the at least portion of the first HDR image is combined with the at least portion of the second HDR image to reduce noise and increase exposure of a resulting combined HDR image.

33 . The apparatus of claim 21 , wherein the apparatus is configured such that at least three different cells are each sampled with at least three different exposure times to generate at least three analog signals for being combined to generate the at least portion of the first HDR.

34 . The apparatus of claim 21 , wherein the apparatus is configured such that the first cell includes a first plurality of photodiodes, and the second cell includes a second plurality of diodes.

35 . The apparatus of claim 21 , wherein the apparatus is configured such that, in response to a user input to capture a photographic scene:
the at least portion of the first HDR image is generated for the photographic scene utilizing a first brightness level at a first time, at least a portion of a second HDR image is generated for the photographic scene utilizing a second brightness level at a second time, and the at least portion of the first HDR image is combined with the at least portion of the second HDR image.

36 . The apparatus of claim 21 , wherein the apparatus is configured such that at least three different cells are each sampled with at least three different exposure times that are at least partially overlapping to generate at least three analog signals for being combined to generate at least a portion of at least three different HDR images including the at least portion of the first HDR image, at least portion of a second HDR image, and at least portion of a third HDR image.

37 . The apparatus of claim 36 , wherein the apparatus is configured such that the at least portion of the first HDR image, the at least portion of the second HDR image and the at least portion of the third HDR image, are combined.

38 . The apparatus of claim 36 , wherein the apparatus is configured such that:
the image sensor, the first amplifier, and the second amplifier are integrated in a single integrated circuit; and the at least portion of the first HDR image, the at least portion of the second HDR image and the at least portion of the third HDR image, are combined, utilizing an application processor.

Assignees

• Duelight Llc

Inventors

• Rivard William
• Feder Adam
• Kindle Brian

Classifications

• H04N23/76

  by influencing the image signals · CPC title

• H04N23/741 Primary

  by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors · CPC title

• H04N25/585

  with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes · CPC title

• H04N23/6811

  based on the image signal · CPC title

• H04N23/72

  Combination of two or more compensation controls · CPC title