Systems, methods, and media for high dynamic range imaging using dead-time-limited single photon detectors

Patent metadata

Field	Value
Publication number	US-10616512-B2
Application number	US-201816047933-A
Country	US
Kind code	B2
Filing date	Jul 27, 2018
Priority date	Jul 27, 2018
Publication date	Apr 7, 2020
Grant date	Apr 7, 2020

Abstract

In accordance with some embodiments, systems, methods and media for high dynamic range imaging using dead-time-limited single photon detectors are provided. In some embodiments, a system for high dynamic range imaging is provided, comprising: an image sensor comprising: a pixels comprising: a single photon detector having dead time τ d ; and a counter coupled to an output of the single photon detector, wherein the counter is configured to increment in response to a signal indicative of detection of a photon output by the single photon detector; and a processor that is programmed to: read out a value stored by the counter after an exposure time has elapsed; and calculate an intensity for the pixel based on the value and the dead time τ d .

First claim

What is claimed is:

1. A system for high dynamic range imaging, the system comprising:
an image sensor comprising:
a pixel comprising:
a single photon detector configured to detect the arrival of a single photon, and having a dead time τ d that is triggered by a detection of a photon and that ends when a predetermined time has elapsed from the time at which the photon is detected; and
a counter coupled to an output of the single photon detector, wherein the counter is configured to increment in response to a signal indicative of detection of a photon output by the single photon detector; and

a processor that is programmed to:
read out, from the pixel, a value stored by the counter after an exposure time has elapsed; and
calculate an intensity value for the pixel based on the value stored by the counter and the dead time τ d .

2. The system of claim 1 , wherein the pixel further comprises:
a fast timing circuit coupled to the output of the single photon detector and configured to output a value indicative of a time at which a signal indicative of detection of a photon is output by the single photon detector;
a first register coupled to an output of the fast timing circuit, wherein the first register is configured to store a value indicative of a time at which a first signal indicative of detection of a photon was output by the single photon detector during the exposure time; and
a second register coupled to the output of the fast timing circuit, wherein the second register is configured to store a value indicative of a time at which a last signal indicative of detection of a photon was output by the single photon detector during the exposure time.

3. The system of claim 2 , wherein the processor is further programmed to:
read out, from the pixel, a first time from the first register;
read out, from the pixel, a second time from the second register; and
calculate an average time between signals indicative of detection of a photon based on the first time, the second time, and the value stored by the counter.

4. The system of claim 3 , wherein the processor is further programmed to:
calculate an estimated photon flux {circumflex over (Φ)} based on the relationship

Φ
^

=

1
q

⁢

(

1

(

X
_

-

τ
d

)

,

where q is the quantum efficiency of the single photon detector, and X is the average time between signals indicative of detection of a photon output by the single photon detector.

5. The system of claim 2 , wherein the fast timing circuit is a time-to-digital converter (TDC).

6. The system of claim 1 , wherein the processor is further programmed to reset the counter at the beginning of the exposure time.

7. The system of claim 1 , wherein the processor is further programmed to:
calculate an estimated photon flux {circumflex over (Φ)} based on the relationship

Φ
^

=

1
q

⁢

N
⁡

(
T
)

T
-

N
⁡

(
T
)

⁢

τ
d

,

where q is the quantum efficiency of the single photon detector, T is the exposure time, and N(T) is the value read from the counter.

8. The system of claim 1 , wherein the single photon detector comprises a single photon avalanche diode (SPAD).

9. The system of claim 1 , wherein the image sensor further comprises a plurality of pixels, each of the plurality of pixels comprising a single photon detector and a counter, and the processor is further programmed to generate image data based on calculated intensity values associated with each of the plurality of pixels and the intensity value associated with the pixel.

10. The system of claim 1 , wherein the image sensor further comprises a plurality of CMOS pixels, and wherein the pixel is adjacent to at least three CMOS pixels of the plurality of CMOS pixels, and the processor is further programmed to generate image data based on calculated intensity values associated with at least a subset of the plurality of CMOS pixels and the intensity value associated with the pixel.

11. A method for high dynamic range imaging using an image sensor comprising a pixel, the pixel comprising a single photon detector configured to detect the arrival of a single photon, and having a dead time τ d that is triggered by a detection of the photon and that ends when a predetermined time has elapsed from the time at which the photon is detected, and a counter coupled to an output of the single photon detector, wherein the counter is configured to increment in response to a signal indicative of detection of a photon output by the single photon detector, the method comprising:
reading out, from the pixel, a value stored by the counter after an exposure time has elapsed; and
calculating an intensity value for the pixel based on the value stored by the counter and the dead time τ d .

12. The method of claim 11 , wherein the pixel further comprises a fast timing circuit configured to output a value indicative of a time at which a signal indicative of detection of a photon is output by the single photon detector, a first register, and a second register, the method further comprising:
receiving, at the fast timing circuit, an output from the single photon detector indicative of detection of a photon;
in response to receiving the output from the single photon detector indicative of detection of a photon, outputting a value indicative of a current time from the fast timing circuit to the first register and the second register;
recording, using the first register, a value indicative of a time at which a first signal indicative of detection of a photon was output by the single photon detector; and
recording, using the second register, a value indicative of a time at which a last signal indicative of detection of a pho

Assignees

• Wisconsin Alumni Res Found

Inventors

• Ingle Atul Nishikant
• Gupta Mohit
• Velten Andreas

Classifications

• H01L27/14643

  Electricity · mapped topic

• H01L31/107

  Electricity · mapped topic

• H04N5/3696

  Electricity · mapped topic

• H04N5/35509 Primary

  Electricity · mapped topic

• H04N5/3742

  Electricity · mapped topic