Apparatus and method for generating depth image

Patent metadata

Field	Value
Publication number	US-9366759-B2
Application number	US-92980511-A
Country	US
Kind code	B2
Filing date	Feb 16, 2011
Priority date	Jun 25, 2010
Publication date	Jun 14, 2016
Grant date	Jun 14, 2016

Abstract

Provided is a depth image generating apparatus and method. The light-receiving unit may include a first gate and a second gate and a depth calculator to calculate a depth based on first light information through fourth light information. The first gate may obtain the first light information from a reflected light of a light emitted based on a first pulse and the second gate may obtain the second light information from a reflected light of a light emitted based on a second pulse, and then the first gate may obtain the third light information from a reflected light of a light emitted based on a third pulse and the second gate may obtain the fourth light information from a reflected light of a light emitted based on a fourth pulse.

First claim

What is claimed is:

1. An apparatus for generating a depth image, the apparatus comprising:
a light receiver including a first gate and a second gate; and
a processor including,
a depth calculator configured to calculate a depth as the depth of the depth image based on first light information through fourth light information,

wherein the first gate obtains the first light information from a reflected light of a light emitted based on a first pulse and the second gate obtains the second light information from a reflected light of a light emitted based on a second pulse, and then the first gate obtains the third light information from a reflected light of a light emitted based on a third pulse and the second gate obtains the fourth light information from a reflected light of a light emitted based on a fourth pulse,
wherein the first pulse, the second pulse, the third pulse, and the fourth pulse are separate from each other,
wherein the depth calculator is configured to calculate the depth based on a first difference and a second difference, the first difference being a difference between the first light information and the second light information and the second difference being a difference between the third light information and the fourth light information, and
wherein the depth calculator is configured to select, based on values of the first difference and the second difference, a scheme from among different schemes used to calculate the depth, and calculate the depth using the selected scheme.

2. The apparatus of claim 1 , wherein the different schemes include a scheme for each of a condition where both the first difference and the second difference are greater than or equal to zero, a condition where the first difference is less than zero and the second difference is greater than or equal to zero, a condition where both the first difference and the second difference are less than zero, and a condition where the first difference is greater than or equal to zero and the second difference is less than zero.

3. The apparatus of claim 1 , further comprising:
a pulse controller configured to simultaneously provide the first pulse and the second pulse to the first gate and the second gate, respectively, and then, to simultaneously provide the third pulse and the fourth pulse to the first gate and the second gate, respectively.

4. The apparatus of claim 1 , wherein a phase difference between the first pulse and the second pulse is 180 degrees, a phase difference between the third pulse and the fourth pulse is 180 degrees, a phase difference between the first pulse and the third pulse is 90 degrees, and a phase difference between the second pulse and the fourth pulse is 90 degrees.

5. The apparatus of claim 4 , wherein an on-off period of the first pulse is the same as an on-off period of light emission, and the third pulse is generated after the light emission, and wherein the period of the third pulse is one-half of the period of the first pulse.

6. A method for generating a depth image, the method comprising:
obtaining first light information and second light information respectively from a reflected light of a light emitted based on a first pulse and from a reflected light of a light emitted based on a second pulse;
obtaining third light information and fourth light information respectively from a reflected light of a light emitted based on a third pulse and from a reflected light of a light emitted based on a fourth pulse; and
calculating a depth as the depth of the depth image based on the first light information through the fourth light information,
wherein the first pulse, the second pulse, the third pulse, and the fourth pulse are separate from each other, and
wherein the calculating the depth based on the first light information through the fourth light information includes,
selecting, based on values of a first difference and a second difference, a scheme from among different schemes used to calculate the depth, the first difference being a difference between the first light information and the second light information and the second difference being a difference between the third light information and the fourth light information, and
calculating the depth using the selected scheme.

7. The method of claim 6 , wherein the different schemes include a scheme for each of a condition where both the first difference and the second difference are greater than or equal to zero, a condition where the first difference is less than zero and the second difference is greater than or equal to zero, a condition where both the first difference and the second difference are less than zero, and a condition where the first difference is greater than or equal to zero and the second difference is less than zero.

8. The method of claim 6 , wherein the first pulse and the second pulse are simultaneously provided to the first gate and the second gate, respectively, and then, the third pulse and the fourth pulse are simultaneously provided to the first gate and the second gate, respectively.

9. The method of claim 6 , wherein a phase difference between the first pulse and the second pulse is 180 degrees, a phase difference between the third pulse and the fourth pulse is 180 degrees, a phase difference between the first pulse and the third pulse is 90 degrees, and a phase difference between the second pulse and the fourth pulse is 90 degrees.

10. The method of claim 9 , wherein an on-off period of the first pulse is the same as an on-off period of light emission, and the third pulse is generated after the light emission, and wherein the period of the third pulse is one-half of the period of the first pulse.

11. The method of claim 6 , wherein:
the first light information comprises a total quantity of electric charge from the reflected light of the light emitted on the first pulse signal;
the second light information comprises a total quantity of electric charge from the reflected light of the light emitted on the second pulse signal;
the third light information comprises a total quantity of electric charge from the reflected light of the light emitted on the third pulse signal;
the fourth light information comprises a total quantity of electric charge from the reflected light of the light emitted on the fourth pulse signal; and
the first difference is between the first total quantity of electric charge and the second total quantity of electric charge, and the second difference is between the third total quantity of electric charge and the fourth total quantity of electric charge.

12. The method of claim 6 , further comprising adjusting at least one of a shuttering time of the first gate and a shuttering time of the second gate to extend a maximal measurement distance and to calculate the depth, the shuttering time of the first gate being a time when the first gate is open during a single period, the shuttering time of the second gate being a time when the second gate is open during the single period.

13. At least one non-transitory computer readable recording medium storing computer readable instructions that control at least one processor to implement the method of claim 6 .

14. The apparatus of claim 1 , wherein the apparatus is included in a depth camera.

15. The apparatus of claim 1 , wherein the first and second gates are included in a pixel.

16. The apparatus of claim 1 , wherein at least one of a shuttering time of the first gate and a shuttering time of the second gate is adjusted to extend a maximal measurement distance and to calculate the depth of the image, the shuttering time of the firs

Assignees

• Kang Byong Min
• Lee Kee Chang
• Kim Seong Jin
• Samsung Electronics Co Ltd

Inventors

• Kang Byong Min
• Lee Kee Chang
• Kim Seong Jin

Classifications

• G01S7/4865 Primary

  Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak (peak detection in noise, signal conditioning G01S7/487) · CPC title

• H04N13/128

  Adjusting depth or disparity · CPC title

• H04N13/254 Primary

  in combination with electromagnetic radiation sources for illuminating objects · CPC title

• G01S17/10

  using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32) · CPC title

• H04N13/271

  wherein the generated image signals comprise depth maps or disparity maps · CPC title