Time-of-flight (TOF) image sensor using amplitude modulation for range measurement

Patent metadata

Field	Value
Publication number	US-10557925-B2
Application number	US-201615340972-A
Country	US
Kind code	B2
Filing date	Nov 1, 2016
Priority date	Aug 26, 2016
Publication date	Feb 11, 2020
Grant date	Feb 11, 2020

Abstract

The Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in an image sensor. The pixel may be a two-tap pixel or a one-tap pixel. Two photoelectron receiver circuits in the pixel receive respective analog modulating signals. The distribution of the received photoelectron charge between these two circuits is controlled by the difference (or ratio) of the two analog modulating voltages. The differential signals generated in this manner within the pixel are modulated in time domain for TOF measurement. Thus, the TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The TOF-based measurement of range and its resolution are controllable by changing the duration of modulation. An autonomous navigation system with these features may provide improved vision for drivers under difficult driving conditions like low light, fog, bad weather, or strong ambient light.

First claim

What is claimed is:

1. A method comprising:
projecting a laser pulse onto a three-dimensional (3D) object;
applying a first analog modulating signal to a first photoelectron receiver and a second analog modulating signal to a second photoelectron receiver in a pixel, and wherein the second analog modulating signal is an inverse of the first analog modulating signal;
detecting a returned pulse using the first and the second photoelectron receivers, wherein the returned pulse is the projected pulse reflected from the 3D object;
generating a pair of signal values in response to photoelectron receiver-specific detections of the returned pulse, wherein the pair of signal values includes a first signal value and a second signal value, and wherein each of the first and the second signal values is based on modulation received from a respective one of the first and the second analog modulating signals; and
determining a Time of Flight (TOF) value of the returned pulse using a ratio of the first signal value to a total of the first and the second signal values.

2. The method of claim 1 , wherein the first photoelectron receiver includes a first photogate and the second photoelectron receiver includes a second photogate, and wherein the first analog modulating signal is applied to the first photogate and the second analog modulating signal is applied to the second photogate.

3. The method of claim 1 , further comprising:
further applying a shutter signal to the pixel, wherein the first and the second analog modulating signals are applied substantially simultaneously with the shutter signal; and
detecting the returned pulse using the first and the second photoelectron receivers while the shutter signal as well as the first and the second analog modulating signals are active.

4. The method of claim 3 , wherein the shutter signal is applied a pre-determined time period after projecting the laser pulse.

5. The method of claim 1 , further comprising:
determining a distance to the 3D object based on the TOF value.

6. The method of claim 1 , wherein projecting the laser pulse includes:
projecting the laser pulse using a light source that is one of the following:
a laser light source;
a light source that produces light in a visible spectrum;
a light source that produces light in a non-visible spectrum;
a monochromatic illumination source;
an Infrared (IR) laser;
an X-Y addressable light source;
a point source with two-dimensional (2D) scanning capability;
a sheet source with one-dimensional (1D) scanning capability; and
a diffused laser.

7. The method of claim 1 , wherein the pixel is a two-tap pixel, and wherein generating the pair of signal values includes:
obtaining from the pixel a first pixel-specific output substantially simultaneously with a second pixel-specific output after detection of the returned pulse, wherein the first pixel-specific output is amplitude modulated by the first analog modulating signal and the second pixel-specific output is amplitude modulated by the second analog modulating signal;
sampling the first and the second pixel-specific outputs substantially simultaneously using an Analog-to-Digital Converter (ADC) unit; and
based on the sampling, generating the first signal value corresponding to the first pixel-specific output and the second signal value corresponding to the second pixel-specific output substantially in parallel using the ADC unit.

8. The method of claim 1 , wherein the pixel is a one-tap pixel, and wherein generating the pair of signal values includes:
obtaining from the pixel a first pixel-specific output followed by a second pixel-specific output after detection of the returned pulse, wherein the first pixel-specific output is amplitude modulated by the first analog modulating signal and the second pixel-specific output is amplitude modulated by the second analog modulating signal;
sampling the first and the second pixel-specific outputs using an Analog-to-Digital Converter (ADC) unit; and
based on the sampling, generating the first signal value corresponding to the first pixel-specific output and the second signal value corresponding to the second pixel-specific output using the ADC unit.

9. The method of claim 1 , wherein the pixel is a one-tap pixel, and wherein generating the pair of signal values includes:
obtaining from the pixel a first pixel-specific output followed by a second pixel-specific output after detection of the returned pulse, wherein the first pixel-specific output is amplitude modulated by the first analog modulating signal and the second pixel-specific output is amplitude modulated by the second analog modulating signal;
first sampling the first pixel-specific output using an Analog-to-Digital Converter (ADC) unit;
based on the first sampling, generating the first signal value using the ADC unit;
second sampling a total of the first and the second pixel-specific outputs using the ADC unit; and
based on the second sampling, generating the total of the first and the second signal values using the ADC unit.

10. The method of claim 1 , wherein the first and the second analog modulating signals are time-varying.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Wang Yibing Michelle
• Lee Tae-Yon
• Ovsiannikov Ilia

Classifications

• G01S7/4865

  Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak (peak detection in noise, signal conditioning G01S7/487) · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G01S17/10

  using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32) · CPC title

• G01S7/4868

  Controlling received signal intensity or exposure of sensor · CPC title

• G06T7/521

  from laser ranging, e.g. using interferometry; from the projection of structured light · CPC title