3D zoom imager

Patent metadata

Field	Value
Publication number	US-9720089-B2
Application number	US-201213356618-A
Country	US
Kind code	B2
Filing date	Jan 23, 2012
Priority date	Jan 23, 2012
Publication date	Aug 1, 2017
Grant date	Aug 1, 2017

Abstract

A 3D imager comprising two cameras having fixed wide-angle and narrow angle FOVs respectively that overlap to provide an active space for the imager and a controller that determines distances to features in the active space responsive to distances provided by the cameras and a division of the active space into near, intermediate, and far zones.

First claim

The invention claimed is:

1. A three-dimensional (3D) imaging system that images features in an active space and determines distances to the features, the imaging system comprising:
a light source that illuminates the active space with at least one light pulse;
first and second three dimensional (3D) cameras having optical centers and comprising first and second photosensors respectively having pixels on which the cameras image light reflected from the at least one light pulse to acquire distance images of the features, wherein the first and second 3D cameras have wide-angle and narrow-angle fields of view (FOVs) respectively, which overlap to provide the active space and each camera is operable to acquire distance images of the features in the active space independent of the other 3D camera;
a plurality of range bounds that divide the active space into zones, the range bounds comprising a near range upper bound, “NR U ”, and a far range lower bound “FR L ”; and
a controller that processes the distance images responsive to the zones to determine distances to the features.

2. The 3D imaging system according to claim 1 wherein the range bounds satisfy a relationship FR L <NR U and divide the active space into near, intermediate, and far zones, for which distances to features in the active space are less than FR L , between FR L and NR U , and greater than NR U respectively.

3. The 3D imaging system according to claim 2 wherein to provide a range image comprising distances to features in the active space, the controller:
designates one of the 3D cameras a prime camera and the other a secondary camera;
determines for each of a plurality of pixels in the prime camera a trial distance for a feature in the active space that is imaged on the pixel;
determines the distance to the feature to be the trial distance if the prime camera is the first camera and the determined distance is in the near zone or the prime camera is the second camera and the trial distance is in the far zone;
determines the distance responsive to the trial distance and a distance provided by a pixel in the secondary camera if the prime camera is the first camera and the determined distance is not in the near zone or the prime camera is the second camera and the trial distance is not in the far zone; and
uses the distances determined for the pixels in the prime camera for the distances in the range image.

4. The 3D imaging system according to claim 3 wherein the trial distance lies in the intermediate zone.

5. The 3D imaging system according to claim 4 wherein the controller determines the distance to the feature as an average of the trial distance and the distance provided by the pixel in the secondary camera.

6. The 3D imaging system according to claim 5 wherein the average is a weighted average.

7. The 3D imaging system according to claim 3 wherein the prime camera is the first camera and the trial distance lies in the far zone or the prime camera is the second camera and the trial distance lies in the near zone.

8. The 3D imaging system according to claim 7 wherein the controller determines which pixels in the secondary camera image points along a line that passes through the pixel in the prime camera and the optical center of the prime camera.

9. The 3D imaging system according to claim 8 , wherein the controller determines a distance for each of the determined pixels in the secondary camera responsive to a distance image acquired by the pixel with light from the at least one light pulse.

10. The 3D imaging system according to claim 9 wherein the controller determines a probability distribution that a given distance along a line that passes through the optical center of the secondary camera and the determined pixel is an actual distance of the feature imaged on the determined pixel from the secondary camera.

11. The 3D imaging system according to claim 10 wherein the controller determines a probability distribution that a given distance along the line in the prime camera is an actual distance of the feature imaged on the prime camera pixel from the prime camera.

12. The 3D imaging system according to claim 11 wherein the controller uses the probability distributions determined for the given distances from the prime camera and the secondary camera to determine a distance of the feature imaged on the prime camera pixel from the prime camera.

13. The 3D imaging system according to claim 1 wherein a camera of the first and second 3D cameras is a time of flight (TOF) camera.

14. A method of determining distance to features located in an active space, the method comprising:
illuminating the active space with at least one light pulse;
imaging features in the active space using first and second three dimensional (3D) cameras having optical centers and comprising first and second photosensors respectively having pixels on which the cameras image light reflected from the at least one light pulse to acquire distance images of the features, wherein the first and second 3D cameras have wide-angle and narrow-angle fields of view (FOVs) respectively, which overlap to provide the active space, and each camera is operable independent of the other to acquire distance measurements for the features in the active space;
dividing the active space into zones delimited by a plurality of range bounds the range bounds comprising a a near range upper bound, “NR U ”, and a far range lower bound “FR L ”; and
processing the distance images responsive to the zones to determine distances to the features.

15. A method according to claim 14 wherein the range bounds satisfy a relationship FR L <NR U and divide the active space into near, intermediate, and far zones, for which distances to features in the active space are less than FR L , between FR L and NR U , and greater than NR U respectively.

16. The method according to claim 15 and comprising:
designating one of the 3D cameras a prime camera and the other a secondary camera;
determining for each of a plurality of pixels in the prime camera a trial distance for a feature in the active space that is imaged on the pixel;
determining the distance to the feature to be the trial distance if the prime camera is the first camera and the determined distance is in the near zone or the prime camera is the second camera and the trial distance is in the far zone;
determining the distance responsive to the trial distance and a distance provided by a pixel in the secondary camera if the prime camera is the first camera and the determined distance is not in the near zone or the prime camera is the second camera and the trial distance is not in the far zone; and
using the distances determined for the pixels in the prime camera for the distances in the range image.

17. The method according to claim 16 wherein the trial distance lies in the intermediate zone.

18. The method according to claim 17 and determining the distance to the feature as an average of the trial distance and the distance provided by the pixel in the secondary camera.

19. A 3D imaging system that images features in an active space and determines distances to the features, the imaging system comprising:
a light source that illuminates the active space with at least one light pulse;
first and second three dimensional (3D) cameras having optical centers and comprising first and second photosensors respectively having pixels on which the cameras image light reflected from the at least one light pulse to acquire distance images of the features, wherein the first and seco

Assignees

• Katz Sagi
• Adler Avishai
• Yahav Giora
• Cohen David
• Larry Eli
• Felzenshtein Shlomo
• Microsoft Technology Licensing Llc

Inventors

• Katz Sagi
• Adler Avishai
• Yahav Giora
• Cohen David
• Larry Eli
• Felzenshtein Shlomo

Classifications

• G01S17/10 Primary

  using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32) · CPC title

• H04N13/239

  using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) · CPC title

• G01S17/87

  Combinations of systems using electromagnetic waves other than radio waves · CPC title

• G01S17/894

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title

• H04N13/00 Primary

  Stereoscopic video systems; Multi-view video systems; Details thereof · CPC title