Active compensation for phase alignment errors in time-of-flight cameras

Patent metadata

Field	Value
Publication number	US-2016116576-A1
Application number	US-201514876392-A
Country	US
Kind code	A1
Filing date	Oct 6, 2015
Priority date	Oct 24, 2014
Publication date	Apr 28, 2016
Grant date	—

Abstract

Methods, apparatuses, and systems can be provided to implement active feedback to electrically sense or monitor the illumination and shutter pulses and adjust them actively to maintain the desired phase relationship/difference between the pulses. By maintaining the desired phase difference, the distance calculation can be made more accurate, even when conditions of the time-of-flight camera varies (e.g., temperature, aging, etc.). Advantageously, active compensation can correct for errors ‘on-the-fly’, eliminating detailed characterization and manual adjustment during operation.

First claim

What is claimed is:

1 . A method for active compensation of phase alignment errors in time-of-flight cameras comprising an illuminator and a shutter driver, the method includes:
sensing a first actual electrical pulse at the illuminator; sensing a second actual electrical pulse at the shutter driver; and adjusting one or more of the following:
a first output electrical pulse being provided to the illuminator based on the first actual electrical pulse and a first reference electrical pulse; and
a second output electrical pulse being provided to the shutter driver based on the second actual electrical pulse and a second reference electrical pulse.

2 . The method of claim 1 , wherein adjusting the first output electrical pulse comprises:
comparing the first actual electrical pulse with the first reference electrical pulse using a phase detector to determine a first phase error; and adjusting the first output electrical pulse for the illuminator based on the first phase error.

3 . The method of claim 1 , wherein adjusting the second output electrical pulse comprises:
comparing the second actual electrical pulse with a second reference electrical pulse using the phase detector to determine a second phase error; and adjusting the second output electrical pulse for the shutter driver based on the second phase error.

4 . The method of claim 1 , wherein sensing the first actual electrical pulse comprises sensing an electrical pulse at a circuit node in the illuminator, and the first actual electrical pulse representative of a pulse which turns on a light source in the illuminator.

5 . The method of claim 1 , wherein sensing the first actual electrical pulse comprises:
sensing light emitted by a light source in the illuminator using a photo-sensitive element in the illuminator; and generating, by the photo-sensitive element, an electrical pulse as the first actual electrical pulse in response to sensing the light emitted by the light source.

6 . The method of claim 1 , wherein adjusting the first output electrical pulse comprises adjusting the first output electrical pulse to drive a first phase error between the first actual electrical pulse and the first reference electrical pulse to zero or reduce the first phase error.

7 . The method of claim 1 , wherein adjusting the first output electrical pulse comprises:
determining a first phase error between the first actual electrical pulse and a first reference electrical pulse; and filtering the first phase error according to a first time constant of a first feedback loop having the first actual electrical pulse as a feedback signal before using the first phase error to adjust the first output electrical pulse.

8 . The method of claim 1 , wherein adjusting the second output electrical pulse comprises adjusting the second output electrical pulse to drive a second phase error between the second actual electrical pulse and the second reference electrical pulse to zero or reduce the second phase error.

9 . The method of claim 1 , wherein adjusting the second output electrical pulse comprises:
determining a second phase error between the second actual electrical pulse and a second reference electrical pulse; and filtering the second phase error according to a second time constant of a second feedback loop having the second actual electrical pulse as a feedback signal before using the second phase error to adjust the second output electrical pulse.

10 . Circuitry for active compensation for phase alignment errors in time-of-flight cameras comprising an illuminator and a shutter driver, the circuitry comprising:
a first comparator circuit for sensing a first actual electrical pulse at the illuminator and determining a first phase error between the first actual electrical pulse and a first reference electrical pulse; a second comparator circuit for sensing a second actual electrical pulse at the shutter driver and determining a second phase error between the second actual electrical pulse and a second reference electrical pulse; a first actuator circuit for generating a first output electrical pulse being provided to the illuminator based on the first phase error; and a second actuator circuit for generating a second output electrical pulse being provided to the shutter driver based on the second phase error.

11 . The circuitry of claim 10 , wherein:
the first phase error comprises a first difference in phase or timing between the first actual electrical pulse and the first reference electrical pulse.

12 . The circuitry of claim 10 , wherein:
the second phase error comprises a second difference in phase or timing between the second actual electrical pulse and the second reference electrical pulse.

13 . The circuitry of claim 10 , wherein:
the first actuator circuit includes a first programmable time constant for filtering the first phase error before using the first phase error to adjust the first output electrical pulse.

14 . The circuitry of claim 10 , wherein:
the second actuator circuit includes a second programmable time constant for filtering the second phase error before using the second phase error to adjust the second output electrical pulse.

15 . The circuitry of claim 10 , wherein:
the first actuator circuit adaptively adjusts the first output electrical pulse being provided to the illuminator to drive the first phase error to zero; and the second actuator circuit adaptively adjusts the second output electrical pulse being provided to the shutter driver to drive the second phase error to zero.

16 . The circuitry of claim 10 , further comprising:
a pulse generator configured to generate the first reference electrical pulse and the second reference electrical pulse with predetermined timing for determining distance information associated with object being illuminated by the illuminator.

17 . A time-of-flight system with active compensation for phase alignment error, the system comprising:
a driver driving a light source; an electronic shutter driver coupled to an image sensor; a first sensing circuitry for sensing a first actual electrical pulse at the driver driving the light source; a second sensing circuitry for sensing a second actual electrical pulse at the electronic shutter driver; a first compensation circuitry for adjusting a first output electrical pulse being provided to the driver driving the light source based on the first actual electrical pulse and a first reference electrical pulse; and a second compensation circuitry for adjusting a second output electrical pulse being provided to the electronic shutter driver based on the second actual electrical pulse and a second reference electrical pulse; wherein captured image signals from the image sensor and predetermined phase differences associated with the first and second output electrical pulses are used for computing a distance of an object from the time-of-flight system.

18 . The time-of-flight system of claim 17 , wherein the second actual electrical pulse serves as the first reference electrical pulse.

19 . The time-of-flight system of claim 17 , wherein the first actual electrical pulse serves as the second reference electrical pulse.

20 . The time-of-flight system of claim 17 , wherein:
the first reference electrical pulse and the second reference electrical pulse represent desired electrical pulses having a predetermined phase difference; the first compensation circuitry adjust the first output electrical pulse being

Assignees

• Analog Devices Inc

Inventors

• Barnes Erik D

Classifications

• H04N25/71

  Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• G01S7/484

  Transmitters · CPC title

• G01S7/4865 Primary

  Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak (peak detection in noise, signal conditioning G01S7/487) · CPC title

• G01S17/894

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title