Auto range control for active illumination depth camera

Patent metadata

Field	Value
Publication number	US-10451189-B2
Application number	US-201715730142-A
Country	US
Kind code	B2
Filing date	Oct 11, 2017
Priority date	Dec 21, 2015
Publication date	Oct 22, 2019
Grant date	Oct 22, 2019

Abstract

A method and apparatus for auto range control are described. In one embodiment, the apparatus comprises a projector configured to project a sequence of light patterns on an object; a first camera configured to capture a sequence of images of the object illuminated with the projected light patterns; a controller coupled to the projector and first camera and operable to receive the sequence of images and perform range control by controlling power of the sequence of light patterns being projected on the object and exposure time of a camera based on information obtained from the sequence of images captured by the camera.

First claim

We claim:

1. An apparatus comprising:
a camera configured to capture a sequence of images of an object illuminated with a sequence of light patterns projected on the object; and
a controller coupled to the camera, and operable to receive the sequence of images and to perform range control by controlling (1) light power of the sequence of light patterns being projected on the object and (2) exposure time of the camera based on information obtained from the sequence of images captured by the camera.

2. The apparatus defined in claim 1 wherein the information comprises intensity information associated with the sequence of images captured by the camera.

3. The apparatus defined in claim 2 wherein the intensity information comprises an average intensity obtained by averaging differences between intensity values of images of the object captured by the camera.

4. The apparatus defined in claim 3 wherein the controller is operable to control depth dynamic range of the camera by decreasing the light power if the average intensity is above a threshold and the exposure time is set to a preset minimal value, and decreasing the exposure time if the average intensity is above the threshold and the exposure time is not set to the preset minimal value.

5. The apparatus defined in claim 3 wherein the controller is operable to control depth dynamic range of the camera by increasing the exposure time if the average intensity is below a threshold and the light power is set to a preset maximal value, and increasing the light power if the average intensity is below the threshold and the light power is not set to the preset maximal value.

6. The apparatus defined in claim 1 wherein the controller is operable to control the light power of the sequence of light patterns being projected on the object and the exposure time of the camera based on the information obtained from the sequence of images captured by the camera by performing automatic projector gain and automatic exposure control based on object intensity.

7. The apparatus defined in claim 6 wherein performing automatic projector gain and automatic exposure control comprises
activating the automatic projector gain when the object intensity associated with the object increases and increasing the light power as the object intensity decreases until the light power reaches a preset maximum value, and
when the light power reaches the preset maximum value, then activating the automatic exposure control until the exposure time reaches a preset minimum value, after which time the automatic projector gain is activated.

8. The apparatus defined in claim 1 wherein the controller is operable to reconstruct depth using triangulation.

9. The apparatus defined in claim 1 , further comprising an infrared (IR) projector to project the sequence of light patterns on the object, wherein the camera comprises an IR camera.

10. A method comprising:
projecting a sequence of light patterns on an object;
capturing a sequence of images of the object illuminated with the projected light patterns using a camera; and
controlling depth dynamic range of the camera by controlling (1) light power of the sequence of light patterns being projected on the object and (2) exposure time of the camera based on information obtained from the sequence of images captured by the camera.

11. The method defined in claim 10 wherein the information comprises intensity information associated with the sequence of images captured by the camera.

12. The method defined in claim 11 wherein the intensity information comprises an average intensity obtained by averaging differences between intensity values of images of the object captured by the camera.

13. The method defined in claim 12 wherein controlling depth dynamic range of the camera comprises decreasing the light power if the average intensity is above a threshold and the exposure time is set to a preset minimal value, and decreasing the exposure time if the average intensity is above the threshold and the exposure time is not set to the preset minimal value.

14. The method defined in claim 12 wherein controlling depth dynamic range comprises increasing the exposure time if the average intensity is below a threshold and the light power is set to a preset maximal value, and increasing the light power if the average intensity is below the threshold and the light power is not set to the preset maximal value.

15. The method defined in claim 10 wherein controlling depth dynamic range of the camera by controlling the light power of the sequence of light patterns being projected on the object and the exposure time of the camera based on the information obtained from the sequence of images captured by the camera comprises performing automatic projector gain and automatic exposure control based on object intensity.

16. The method defined in claim 15 wherein performing automatic projector gain and automatic exposure control comprises
activating the automatic projector gain when the object intensity associated with the object increases and increasing the light power as the object intensity decreases until the light power reaches a preset maximum value, and
when the light power reaches the preset maximum value, then activating the automatic exposure control until the exposure time reaches a preset minimum value, after which time the automatic projector gain is activated.

17. The method defined in claim 10 wherein the light power of the sequence of light patterns comprises laser power projected on the object by an infrared (IR) projector.

18. An article of manufacture having one or more non-transitory computer readable storage media storing instructions which when executed by a system perform a method comprising:
capturing, using a camera, a sequence of images of an object illuminated with a sequence of light patterns projected on the object; and
controlling depth dynamic range by controlling (1) light power of the sequence of light patterns being projected on the object and (2) exposure time of the camera based on information obtained from the sequence of images captured by the camera.

19. The article of manufacture defined in claim 18 wherein the information comprises intensity information associated with the sequence of images captured by the camera, and the intensity information comprises an average intensity obtained by averaging differences between intensity values of images of the object captured by the camera.

20. The article of manufacture defined in claim 19 wherein controlling depth dynamic range comprises:
decreasing the light power if the average intensity is above a first threshold and the exposure time is set to a preset minimal value;
decreasing the exposure time if the average intensity is above the first threshold and the exposure time is not set to the preset minimal value;
increasing the exposure time if the average intensity is below a second threshold and the light power is set to a preset maximal value; and
increasing the light power if the average intensity is below the second threshold and the light power is not set to the preset maximal value.

Assignees

• Intel Corp

Inventors

• Zabatani Aviad
• Sperling Erez
• Mulla Ofir
• Kimmel Ron
• Bronstein Alex
• Bronstein Michael
• Silver David H
• Menashe Ohad
• Surazhsky Vitaly

Classifications

• G01B11/25

  by projecting a pattern, e.g. {one or more lines,} moiré fringes on the object (G01B11/255 takes precedence {; image analysis for depth or shape recovery G06T7/50}) · CPC title

• H04N23/74 Primary

  by influencing the scene brightness using illuminating means · CPC title

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• H04N23/73

  by influencing the exposure time · CPC title