Two frequency time-of-flight three-dimensional image sensor and method of measuring object depth

Patent metadata

Field	Value
Publication number	US-10382736-B1
Application number	US-201815892706-A
Country	US
Kind code	B1
Filing date	Feb 9, 2018
Priority date	Feb 9, 2018
Publication date	Aug 13, 2019
Grant date	Aug 13, 2019

Abstract

A three-dimensional image system includes a modulator configured to generate a first and a second modulation signal having a predetermined frequency difference, an illumination source configured to generate a light signal modulated by the first modulation signal, and a pixel array modulated by the second modulation signal. At least one pixel of the pixel array is configured to receive a reflected modulated light signal and generate a plurality of measurement signals based on a plurality of image acquisitions taken at different acquisition times. A controller is configured to control a phase difference between the first modulation signal and the second modulation signal by setting the first modulation frequency and the second modulation frequency to have a predetermined frequency difference greater than zero; and calculate a depth of the object based on the plurality of measurement signals, the depth being a distance from the 3DI system to the object.

First claim

What is claimed is:

1. A three-dimensional image (3DI) system comprising:
a modulator configured to generate a first modulation signal having a first modulation frequency and a second modulation signal having a second modulation frequency;
an illumination source configured to generate a modulated light signal based on the first modulation signal;
a sensor core including a pixel array modulated by the second modulation signal, wherein at least one pixel of the pixel array is configured to receive the modulated light signal reflected from an object as a reflected modulated light signal and to demodulate the reflected modulated light signal using the second modulation signal during an image acquisition to generate a measurement signal, wherein the at least one pixel is configured to generate a plurality of measurement signals based on a plurality of image acquisitions taken at different acquisition times; and
a control unit including at least one processor, the control unit configured to:
control a phase difference between the first modulation signal and the second modulation signal by setting the first modulation frequency and the second modulation frequency to have a predetermined frequency difference greater than zero;
control the sensor core to initiate the plurality of image acquisitions at the different acquisition times;
receive the plurality of measurement signals, and
calculate a depth of the object based on the plurality of measurement signals, wherein the depth is a distance from the 3DI system to the object.

2. The 3DI system of claim 1 , wherein the at least one processor is configured to:
select a plurality of phase differences between the first modulation signal and the second modulation signal, wherein the at least one processor is configured to select the phase difference for at least part of each image acquisition, and
determine the different acquisition times, including determining an acquisition time for each of the plurality of image acquisitions based on the predetermined frequency difference configured for a corresponding image acquisition and based on the phase difference configured for the corresponding image acquisition.

3. The 3DI system of claim 1 , wherein each of the different acquisition times includes an integration time and a waiting time subsequent to the integration time, and
the control unit is configured to set the predetermined frequency difference for at least one of:
at least a portion of the integration time for each of the plurality of image acquisitions or at least a portion of the waiting time for each of the plurality of image acquisitions.

4. The 3DI system of claim 1 , wherein each of the different acquisition times includes an integration time and a waiting time subsequent to the integration time,
the control unit is configured to set the predetermined frequency difference at a constant value during at least part of the waiting time such that the phase difference between the first and the second modulation signal continuously changes during the at least part of the waiting time, and
the control unit is configured to set the first modulation frequency and the second modulation frequency to be the same during the integration time such that the phase difference between the first and the second modulation signal is constant during the integration time.

5. The 3DI system of claim 1 , wherein each of the different acquisition times includes an integration time and a waiting time subsequent to the integration time,
the control unit is configured to set the predetermined frequency difference at a constant value during at least part of the integration time such that the phase difference between the first and the second modulation signal continuously changes during the at least part of the integration time, and
the control unit is configured to set the first modulation frequency and the second modulation frequency to be the same during the waiting time such that the phase difference between the first and the second modulation signal is constant during the waiting time.

6. The 3DI system of claim 1 , wherein each of the different acquisition times includes an integration time and a waiting time subsequent to the integration time, and
the control unit is configured to set the predetermined frequency difference at a constant value during at least part of the integration time and during at least part of the waiting time such that the phase difference between the first and the second modulation signal continuously changes during the at least part of the integration time and the at least part of the waiting time.

7. The 3DI system of claim 1 , wherein each of the different acquisition times includes an integration time and a waiting time subsequent to the integration time,
the control unit is configured to set the predetermined frequency difference at a first constant value during at least part of the integration time such that the phase difference between the first and the second modulation signal continuously changes at a first rate during the at least part of the integration time, and
the control unit is configured to set the predetermined frequency difference at a second constant value, different from the first constant value, during at least part of the waiting time such that the phase difference between the first and the second modulation signal continuously changes at a second rate during the at least part of the waiting time.

8. The 3DI system of claim 1 , wherein the predetermined frequency difference induces a time-dependent phase difference between the first modulation signal and the second modulation signal such that the phase difference between the first and the second modulation signal is changed over time.

9. The 3DI system of claim 1 , wherein the control unit is configured to change the predetermined frequency difference over the plurality of image acquisitions such that the phase difference between the first modulation signal and the second modulation signal is changed between individual image acquisitions of the plurality of image acquisitions.

10. The 3DI system of claim 1 , wherein the control unit is configured to manipulate the predetermined frequency difference arbitrarily over the plurality of image acquisitions.

11. The 3DI system of claim 1 , wherein the control unit is configured to maintain the predetermined frequency difference to be constant over the plurality of image acquisitions.

12. The 3DI system of claim 1 , wherein the control unit is configured to select a number of image acquisitions used for one depth calculation based on a desired depth measurement accuracy, a desired measurement sensitivity, or a desired object tracking rate.

13. The 3DI system of claim 1 , wherein the control unit is configured to continuously change the phase difference over time to more than a 360° phase shift.

14. The 3DI system of claim 1 , wherein the predetermined frequency difference is different for at least two of the plurality of image acquisitions.

15. The 3DI system of claim 1 , wherein the predetermined frequency difference is the same for at least two of the plurality of image acquisitions.

16. The 3DI system of claim 1 , wherein each of the different acquisition times includes an integration time and a waiting time subsequent to the integration time,
plurality of image acquisitions includes a first image acquisition and a second image acquisition, and
the control unit is configured to set the predetermined frequency difference for the integration time of the first image acquisition to be different than the predetermined fre

Assignees

• Infineon Technologies Ag

Inventors

• Thurner Thomas

Classifications

• G01S17/08

  for measuring distance only (indirect measurement G01S17/46; active triangulation systems G01S17/48) · CPC title

• G01S7/4911 Primary

  Transmitters · CPC title

• G01S7/4802

  using analysis of echo signal for target characterisation; Target signature; Target cross-section · CPC title

• G01S17/894

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title

• G01S7/4915

  Time delay measurement, e.g. operational details for pixel components (signal extraction and conditioning G01S7/493); Phase measurement · CPC title