Apparatus for generating depth image

Patent metadata

Field	Value
Publication number	US-9781406-B2
Application number	US-201314423920-A
Country	US
Kind code	B2
Filing date	Aug 28, 2013
Priority date	Sep 3, 2012
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

An apparatus for generating depth image is provided, the apparatus according to an exemplary embodiment of the present disclosure being configured to perform an accurate stereo matching even in a low light level by obtaining RGB images and/or IR images, and using the obtained RGB images and/or IR images to extraction of a depth image.

First claim

The invention claimed is:

1. An apparatus for generating a depth image, the apparatus comprising:
a camera unit configured to obtain any one of left and right RGB images, left and right RGB and IR images (RGB/IR images) and left and right IR images; and
a first generating unit configured to:
control the camera unit to obtain any one of left and right RGB images, the left and right RGB/IR images, and the left and right IR images, and
generate a depth image from the left and right RGB images or the left and right IR images received from the camera unit;
wherein the camera unit comprises:
a first sensor unit configured to obtain any one of the left RGB image, the left RGB/IR image, and the left IR image;
a second sensor unit configured to obtain any one of the right RGB image, the right RGB/IR image, and the right IR image;
a light receiving unit configured to detect an intensity of illumination;
at least one emission unit configured to emit an IR by being turned on or off in response to control of the first generating unit; and
a splitter configured to disperse the IR emitted from the emission unit in a predetermined pattern;
wherein the first generating unit comprises:
a controller configured to control ON and OFF of the emission unit in response to an intensity of light detected by the light receiving unit;
a synchronization unit configured to synchronize the left and right IR images from outputs of the first and second sensor units; and
a second generating unit configured to generate the depth image from the left and right IR images received from the synchronization unit.

2. The apparatus of claim 1 , wherein the emission unit comprises a single IR device or plural IR devices.

3. The apparatus of claim 2 , wherein the IR device includes any one of an LD and an LED.

4. The apparatus of claim 1 , wherein the
splitter is arranged at a front end of the emission unit.

5. The apparatus of claim 1 , wherein the first generating unit further comprises:
a switching unit configured to switch on or switch off the emission unit in response to control of the controller.

6. The apparatus of claim 1 , wherein the controller is configured to change the emission unit to an ON state when the intensity of light detected by the light receiving unit is below a predetermined intensity of illumination.

7. An apparatus for generating a depth image, the apparatus comprising:
a camera unit configured to obtain left and right RGB images, or left and right RGB and IR images (RGB/IR images); and
a first generating unit configured to:
control the camera unit to obtain an RGB image or RGB/IR images, and
generate a depth image from the left/right RGB images or IR image received from the camera unit;
wherein the camera unit comprises:
at least one emission unit configured to emit an IR by being turned on or off in response to control of the first generating unit; and
a splitter configured to disperse the IR emitted from the emission unit in a predetermined pattern; and
wherein the first generating unit comprises:
a synchronization unit configured to synchronize outputs of first and second sensor units;
a second generating unit configured to generate the depth image from the left and right IR images received from the synchronization unit;
a controller configured to turn on or off the emission unit in response to an average brightness of pixel of the left and right RGB images received from the synchronization unit; and
a switching unit configured to switch on or switch off the emission unit in response to control of the controller.

8. The apparatus of claim 7 , wherein:
the first sensor unit is configured to obtain the left RGB image or the left RGB/IR image, and
the second sensor unit is configured to obtain the right RGB image or the right RGB/IR images.

9. The apparatus of claim 8 , wherein the emission unit comprises a single IR device or plural IR devices.

10. The apparatus of claim 9 , wherein the IR device includes any one of an LD and an LED.

11. The apparatus of claim 8 , wherein the camera unit further comprises:
a splitter arranged at a front end of the emission unit to disperse the IR emitted from the emission unit in a predetermined pattern.

12. The apparatus of claim 7 , wherein the controller is configured to turn on the emission unit when an average of pixel of the RGB image is less than a threshold.

Assignees

• Lg Innotek Co Ltd

Inventors

• Lee Jun Seo

Classifications

• G06T7/521 Primary

  from laser ranging, e.g. using interferometry; from the projection of structured light · CPC title

• H04N13/0271

  Electricity · mapped topic

• H04N2013/0081

  Depth or disparity estimation from stereoscopic image signals · CPC title

• G06T2207/10048

  Infrared image · CPC title

• G06T2207/10152

  Varying illumination · CPC title