Depth imaging device and driving method thereof

Patent metadata

Field	Value
Publication number	US-10516873-B2
Application number	US-201815866446-A
Country	US
Kind code	B2
Filing date	Jan 9, 2018
Priority date	Dec 5, 2017
Publication date	Dec 24, 2019
Grant date	Dec 24, 2019

Abstract

A depth imaging device is provided. A first camera and a second camera form a first depth imaging system. A projection element and a second camera form a second depth imaging system. The control unit is configured to instruct one of the first and second depth imaging systems to acquire a depth map and a confidence map, and determine whether each of confidence values in the confidence map is less than a confidence threshold value. If each of the confidence values is less than the confidence threshold value, then the control unit turns on the other of the first and second depth imaging systems. If at least one of the confidence values is not less the confidence threshold value, then the control unit determines whether a closest distance in the depth map falls within a predetermined range or not. A driving method of a depth imaging device is also provided.

First claim

What is claimed is:

1. A depth imaging device, comprising:
a first camera;
a second camera, wherein the first camera and the second camera form a first depth imaging system;
a projection element, wherein the projection element and the second camera form a second depth imaging system, wherein a distance between the projection element and the second camera is not equal to a distance between the first camera and the second camera; and
a controller, electrically connected to the first camera, the second camera and the projection element, wherein the controller is configured to instruct one of the first depth imaging system and the second depth imaging system to acquire a depth map and a confidence map corresponding to the depth map, and determine whether each of confidence values in the confidence map is smaller than a confidence threshold value for one of the first depth imaging system and the second depth imaging system, in response to determining that each of the confidence values is smaller than the confidence threshold value for one of the first depth imaging system and the second depth imaging system, the controller turns on the other one of the first depth imaging system and the second depth imaging system, in response to determining that at least one of the confidence values is not smaller than the confidence threshold value, the controller determines whether a closest distance in the depth map falls within a predetermined range, in response to determining that the closest distance falls within the predetermined range, the controller does not turn on the other one of the first depth imaging system and the second depth imaging system, and in response to determining that the closest distance is not within the predetermined range, the controller turns on the other one of the first depth imaging system and the second depth imaging system.

2. The depth imaging device as claimed in claim 1 , wherein the controller is configured to instruct the first depth imaging system to acquire the depth map and the confidence map corresponding to the depth map, and determine whether each of the confidence values in the confidence map is smaller than the confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, the controller turns on the second depth imaging system, and if at least one of the confidence values is not smaller than the confidence threshold value, the controller determines whether the closest distance in the depth map falls within the predetermined range, wherein the predetermined range is that the closest distance is greater than or equal to a distance threshold value, if the closest distance falls within the predetermined range, the controller does not turn on the second depth imaging system, and if the closest distance is not within the predetermined range, the controller turns on the second depth imaging system and the projection element.

3. The depth imaging device as claimed in claim 2 , wherein the distance between the projection element and the second camera is smaller than the distance between the first camera and the second camera.

4. The depth imaging device as claimed in claim 1 , wherein the controller is configured to instruct the second depth imaging system to acquire the depth map and the confidence map corresponding to the depth map, and determine whether each of the confidence values in the confidence map is smaller than the confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, the controller turns off the projection element and turns on the first depth imaging system, and if at least one of the confidence values is not smaller than the confidence threshold value, the controller determines whether the closest distance in the depth map falls within the predetermined range, wherein the predetermined range is that the closest distance is smaller than or equal to a distance threshold value, if the closest distance falls within the predetermined range, the controller does not turn on the first depth imaging system, and if the closest distance is not within the predetermined range, the controller turns off the projection element and turns on the first depth imaging system.

5. The depth imaging device as claimed in claim 4 , wherein the distance between the projection element and the second camera is smaller than the distance between the first camera and the second camera.

6. The depth imaging device as claimed in claim 1 , wherein the first camera, the projection element and the second camera are arranged on a straight line.

7. The depth imaging device as claimed in claim 1 , wherein the projection element is configured to project a structured light.

8. A driving method for a depth imaging device, comprising:
(a) instructing one of a first depth imaging system and a second depth imaging system to acquire a depth map and a confidence map corresponding to the depth map, wherein a first camera and a second camera form the first depth imaging system, and a projection element and the second camera form the second depth imaging system, and a distance between the projection element and the second camera is not equal to a distance between the first camera and the second camera; and
(b) determining whether each of confidence values in the confidence map is smaller than a confidence threshold value for one of the first depth imaging system and the second depth imaging system, in response to determining that each of the confidence values is smaller than the confidence threshold value for one of the first depth imaging system and the second depth imaging system, turning on the other one of the first depth imaging system and the second depth imaging system, and in response to determining that at least one of the confidence values is not smaller than the confidence threshold value, determining whether a closest distance in the depth map falls within a predetermined range, in response to determining that the closest distance falls within the predetermined range, not turning on the other one of the first depth imaging system and the second depth imaging system, and in response to determining that the closest distance is not within the predetermined range, turning on the other one of the first depth imaging system and the second depth imaging system,
wherein the driving method is capable of performing each of the above steps.

9. The driving method for the depth imaging device as claimed in claim 8 , wherein the step (a) comprises instructing the first depth imaging system to acquire the depth map and the confidence map corresponding to the depth map, and the step (b) comprises determining whether each of the confidence values in the confidence map is smaller than the confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, turning on the second depth imaging system, if at least one of the confidence values is not smaller than the confidence threshold value, determining whether the closest distance in the depth map falls within the predetermined range, wherein the predetermined range is that the closest distance is greater than or equal to a distance threshold value, if the closest distance falls within the predetermined range, not turning on the second depth imaging system, and if the closest distance is not within the predetermined range, turning on the second depth imaging system and the projection element.

10. The driving method for the depth imaging device as claimed in claim 9 , wherein the distance between the projection element and the second camera is smaller than the distance between the first camera and the second camera.

11. The driving method for the dep

Assignees

• Lite On Electronics Guangzhou
• Lite On Technology Corp

Inventors

• Wei Shou-Te
• Chen Hsing-Hung

Classifications

• H04N23/60

  Control of cameras or camera modules · CPC title

• G06T7/593

  from stereo images · CPC title

• H04N13/254

  in combination with electromagnetic radiation sources for illuminating objects · CPC title

• H04N13/239 Primary

  using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) · CPC title

• H04N13/271

  wherein the generated image signals comprise depth maps or disparity maps · CPC title