Pulse width modulated integration for time of flight imaging

Patent metadata

Field	Value
Publication number	US-11914036-B2
Application number	US-202017125638-A
Country	US
Kind code	B2
Filing date	Dec 17, 2020
Priority date	Dec 17, 2020
Publication date	Feb 27, 2024
Grant date	Feb 27, 2024

Abstract

One example provides a method of operating a time-of-flight camera system comprising an illumination source and an image sensor. The method comprises operating the illumination source and the image sensor to control a plurality of integration cycles and a plurality of readout cycles. In each integration cycle, the method comprises performing a plurality of pulse width modulated (PWM) illumination cycles where each PWM illumination cycle is separated from one or more adjacent PWM illumination cycles by a non-illumination cycle. For each PWM illumination cycle, the method comprises directing photocharge to in-pixel memory for each pixel that is performing image integration and for each non-illumination cycle conducting photocharge away from the in-pixel memory for each pixel that is performing image integration. The readout cycle comprises, for each pixel that performed image integration, reading a charge stored in the in-pixel memory after the integration cycle.

First claim

The invention claimed is:

1. A method of operating a time-of-flight camera system comprising an illumination source and an image sensor, the image sensor comprising one or more sensor pixels each comprising an in-pixel memory, the method comprising:
operating the illumination source and the image sensor to control a plurality of integration cycles for a readout cycle by
performing a plurality of pulse width modulated (PWM) illumination cycles, each PWM illumination cycle separated from one or more adjacent PWM illumination cycles by a non-illumination cycle,
temporally modulating the illumination source during each PWM illumination cycle to emit temporally modulated light, the temporally modulated light being at different frequencies for at least two different PWM illumination cycles,
during each PWM illumination cycle, directing photocharge to the in-pixel memory for each pixel that is performing image integration, and
during each non-illumination cycle, conducting photocharge away from the in-pixel memory for each pixel that is performing image integration; and

during the readout cycle, for each pixel that performed image integration, reading a charge stored in the in-pixel memory.

2. The method of claim 1 , wherein conducting the photocharge away from the in-pixel memory during each non-illumination cycle comprises draining the photocharge via an anti-blooming gate for each pixel that is performing image integration.

3. The method of claim 1 , wherein conducting the photocharge away from the in-pixel memory comprises draining the photocharge via a reset path.

4. The method of claim 1 , wherein temporally modulating the illumination source comprises temporally modulating the illumination source at a frequency in a range of between 50 kHz and 5 MHz.

5. The method of claim 4 , wherein each PWM illumination cycle further comprises a frequency modulated light signal.

6. The method of claim 5 , wherein the frequency modulated light signal comprises a random phase encoding.

7. A time-of-flight camera system comprising:
an illumination source;
an image sensor comprising one or more sensor pixels each comprising an in-pixel memory;
a logic subsystem; and
a memory comprising instructions executable by the logic subsystem to
operate the illumination source and the image sensor to control a plurality of integration cycles for a readout cycle, wherein during each integration cycle, the instructions are executable to
perform a plurality of pulse width modulated (PWM) illumination cycles, each PWM illumination cycle separated from one or more adjacent PWM illumination cycles by a non-illumination cycle,
temporally modulate the illumination source during each PWM illumination cycle to emit temporally modulated light, the temporally modulated light being modulated at different frequencies for at least two different PWM illumination cycles,
during each PWM illumination cycle, direct photocharge to the in-pixel memory for each pixel that is performing image integration, and
during each non-illumination cycle, conduct photocharge away from the in-pixel memory for each pixel that is performing image integration, and

during the readout cycle, for each pixel that performed image integration, read a charge stored in the in-pixel memory.

8. The system of claim 7 , wherein one or more sensor pixels further comprises an anti-blooming gate and wherein the instructions executable to conduct the photocharge away from the in-pixel memory are executable to drain the photocharge via the anti-blooming gate for each pixel that is performing image integration.

9. The system of claim 7 , wherein the instructions executable to conduct the photocharge away from the in-pixel memory are executable to drain the photocharge via a reset path for each pixel that is performing image integration.

10. The system of claim 7 , wherein the instructions executable to temporally modulate the illumination source comprise instructions executable to temporally modulate the illumination source at a frequency in a range of between 50 kHz and 5 MHz.

11. The system of claim 10 , wherein the instructions executable to perform a plurality of PWM illumination cycles are further executable to perform one or more PWM illumination cycles comprising a frequency modulated light signal.

12. The system of claim 11 , wherein the instructions executable to perform a plurality of PWM illumination cycles is further executable to encode a random phase for the frequency modulated light signal.

13. The system of claim 7 , wherein the instructions executable to operate the illumination source and the image sensor to control a plurality of integration cycles for the readout cycle are further executable to operate at least the illumination source and the image sensor within a bandwidth of a connected power source.

14. A time-of-flight camera system comprising:
an illumination source;
an image sensor comprising one or more sensor pixels each comprising an in-pixel memory;
a logic subsystem; and
a memory comprising instructions executable by the logic subsystem to
operate the illumination source and the image sensor to control a plurality of integration cycles for a readout cycle, wherein during each integration cycle, the instructions are executable to
perform a plurality of pulse width modulated (PWM) illumination cycles, each PWM illumination cycle separated from one or more adjacent PWM illumination cycles by a non-illumination cycle,
temporally modulate the illumination source during each PWM illumination cycle to emit temporally modulated light, the temporally modulated light being modulated at different frequencies for at least two different PWM illumination cycles,
during each PWM illumination cycle, direct photocharge to the in-pixel memory for each pixel that is performing image integration; and

during the readout cycle, for each pixel that performed image integration, read a charge stored in the in-pixel memory.

15. The system of claim 14 , wherein the instructions to operate the illumination source and the image sensor to control a plurality of integration cycles for the readout cycle are further executable to, during each non-illumination cycle, operate the image sensor in a reset mode.

16. The system of claim 14 , wherein the instructions executable to temporally modulate the illumination source comprise instructions executable to temporally modulate the illumination source at a frequency in a range of between 50 kHz and 5 MHz.

17. The system of claim 14 , wherein the instructions to operate the illumination source and the image sensor to control a plurality of integration cycles for the readout cycle are further executable to, during each non-illumination cycle, conduct the photocharge away from the in-pixel memory.

18. The system of claim 17 , wherein each pixel of the plurality of pixels further comprises an anti-blooming gate and wherein the instructions executable to conduct the photocharge away from the in-pixel memory are executable to drain the photocharge via the anti-blooming gate for each pixel that is performing image integration.

19. The system of claim 17 , wherein the instructions executable to conduct the photocharge away from the in-pixel memory are executable to drain the photocharge via a reset path for each pixel that is performing image integration.

20. The system of claim 14 , wherein the instructions executable to operate the illumination source and the image sensor to control a plurality of integration cycles for the readout cyc

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Godbaz John Peter
• Roland Brock Mccray
• Jin Rui
• Oh Minseok

Classifications

• G01S17/10 Primary

  using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32) · CPC title

• G01S7/483

  Details of pulse systems · CPC title

• G01S17/26

  wherein the transmitted pulses use a frequency-modulated or phase-modulated carrier wave, e.g. for pulse compression of received signals · CPC title

• G01S17/894 Primary

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title

• G01S7/4915

  Time delay measurement, e.g. operational details for pixel components (signal extraction and conditioning G01S7/493); Phase measurement · CPC title