Accumulating charge from multiple imaging exposure periods

Patent metadata

Field	Value
Publication number	US-9851245-B2
Application number	US-201213670239-A
Country	US
Kind code	B2
Filing date	Nov 6, 2012
Priority date	Nov 6, 2012
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

Embodiments related to accumulating charge during multiple exposure periods in a time-of-flight depth camera are disclosed. For example, one embodiment provides a method including accumulating a first charge on a photodetector during a first exposure period for a first light pulse, transferring the first charge to a charge storage mechanism, accumulating a second charge during a second exposure period for the first light pulse, and transferring the second charge to the charge storage mechanism. The method further includes accumulating an additional first charge during a first exposure period for a second light pulse, adding the additional first charge to the first charge to form an updated first charge, accumulating an additional second charge on the photodetector for a second exposure period for the second light pulse, and adding the additional second charge to the second charge to form an updated second charge.

First claim

The invention claimed is:

1. A method for operating a photosensor comprising an array of photodetectors, the method comprising:
providing a pulsed light output;
for each photodetector of a plurality of photodetectors of the photosensor,
accumulating a first charge for light received from a first pulse of the pulsed light output on the photodetector during a first exposure period for detecting reflected light from the first pulse of the pulsed light output;
transferring the first charge to a charge storage mechanism for the photodetector;
accumulating a second charge for light received from the first pulse of the pulsed light output on the photodetector during a second exposure period for detecting reflected light from the first pulse of the pulsed light output;
transferring the second charge to the charge storage mechanism;
then accumulating an additional first charge for light received from a second pulse of the pulsed light output on the photodetector during a first exposure period for detecting reflected light from the second pulse of the pulsed light output and adding the additional first charge to the first charge to form an updated first charge;
then transferring the updated first charge on the photodetector to the charge storage mechanism;
then accumulating an additional second charge for light received from the second pulse of the pulsed light output on the photodetector during a second exposure period for detecting reflected light from the second pulse of the pulsed light output and adding the additional second charge to the second charge to form an updated second charge; and
converting the updated first charge and the updated second charge to digital values.

2. The method of claim 1 , wherein the pulsed light output is provided by a coherent light source.

3. The method of claim 1 , wherein the first pulse of the pulsed light output provides light centered at first wavelength, wherein the second pulse of the pulsed light output provides light centered at a second wavelength, wherein the second wavelength is different from the first wavelength.

4. The method of claim 3 , wherein the first pulse of the pulsed light output provides substantially red light, wherein the second pulse of the pulsed light output provides substantially blue light, and wherein a third pulse of the pulsed light output provides substantially green light.

5. The method of claim 1 , wherein transferring charge to the charge storage mechanism comprises operating a transfer mechanism coupled between each photodetector and the charge storage mechanism.

6. The method of claim 1 , wherein the photodetectors are interleaved with the charge storage mechanisms in the array.

7. The method of claim 1 , wherein the charge storage mechanism comprises an array of electrodes arranged at least partially around each photodetector.

8. The method of claim 1 , further comprising performing additional exposures during additional light pulses.

9. The method of claim 1 , wherein the photosensor is a time-of-flight depth sensing system, and wherein the digital values represent a depth of a portion of a scene imaged by the photodetector.

10. A method for operating a photosensor comprising an array of photodetectors, the method comprising:
providing a plurality of pulses of a pulsed light output; and
for one or more pulses of the pulsed light output,
at each photodetector of a plurality of photodetectors of the array of photodetectors,
accumulating a first charge for light received from a current pulse of the pulsed light output based on an amount of light incident upon the photodetector during a first exposure period for the current pulse and adding the first charge to charge accumulated for light received at the photodetector from a pulse during each first exposure period of one or more previous pulses of the pulsed light output to form an updated first charge,
accumulating a second charge for light received from the current pulse of the pulsed light output based on an amount of light incident upon the photodetector during a second exposure period of the current pulse and adding the second charge to charge accumulated for light received at the photodetector from a pulse during each second exposure period of the one or more previous pulses of the pulsed light output to form an updated second charge, and
converting the updated first charge and the updated second charge to digital values.

11. The method of claim 10 , wherein accumulating the first charge comprises transferring, from a charge storage mechanism to the photodetector, a sum of charges accumulated during the first exposure periods of all previous pulses of the pulsed light output.

12. The method of claim 11 , wherein charge is transferred between the photodetector and the charge storage mechanism by operating a transfer electrode coupled between the photodetector and the charge storage mechanism.

13. The method of claim 10 , wherein a first pulse of the plurality of pulses of the pulsed light output provides substantially red light, wherein a second pulse of the plurality of pulses of the pulsed light output provides substantially green light, and wherein a third pulse of the plurality of pulses of the pulsed light output provides substantially blue light.

14. The method of claim 10 , further comprising converting the first charge and the second charge to digital values by providing the first charge and the second charge to a readout mechanism coupled to the charge storage mechanism.

15. A pulsed time-of-flight depth camera system, comprising:
a light source;
an image sensor comprising an array of photodetectors, and a charge storage mechanism associated with each photodetector, each of the charge storage mechanism and associated photodetector being configured to allow charge to be transferred between the charge storage mechanism and the associated photodetector;
a logic device; and
a storage device comprising instructions stored thereon that are executable by the logic device to, for each photodetector of the array of photodetectors:
provide a pulsed light output via the light source;
accumulate a first charge for light received from a first pulse of the pulsed light output on the photodetector during a first exposure period for detecting reflected light from the first pulse of the pulsed light output;
transfer the first charge to a charge storage mechanism;
accumulate a second charge for light received from the first pulse of the pulsed light output on the photodetector element during a second exposure period for detecting reflected light from the first pulse of the pulsed light output;
transfer the second charge accumulated on the photodetector to the charge storage mechanism;
transfer the first charge back to the photodetector to receive an additional first charge at the photodetector;
accumulate the additional first charge for light received from a second pulse of the pulsed light output on the photodetector during a first exposure period for detecting reflected light from the second pulse of the pulsed light output to form an updated first charge;
transfer the updated first charge on the photodetector to the charge storage mechanism;
transfer the second charge back to the photodetector to receive an additional second charge at the photodetector;
accumulate the additional second charge for light received from the second pulse of the pulsed light output on the photodetector during a second exposure period for detecting reflected light from the second pulse of the pulsed light output to form an updated second charge, and
convert the updated first charge and the updat

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Cohen David
• Felzeshtein Shlomo
• Larry Eli

Classifications

• G01S17/894

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title

• G01S7/4863 Primary

  Detector arrays, e.g. charge-transfer gates · CPC title

• H04N13/271

  wherein the generated image signals comprise depth maps or disparity maps · CPC title

• G01J1/4228 Primary

  arrangements with two or more detectors, e.g. for sensitivity compensation · CPC title

• H04N13/0271

  Electricity · mapped topic