Depth image provision apparatus and method

Patent metadata

Field	Value
Publication number	US-2017374352-A1
Application number	US-201615190031-A
Country	US
Kind code	A1
Filing date	Jun 22, 2016
Priority date	Jun 22, 2016
Publication date	Dec 28, 2017
Grant date	—

Abstract

Apparatuses, methods and storage media for providing a depth image of an object are described. In some embodiments, the apparatus may include a projector to perform a controlled motion, to project a light pattern on different portions of the scene at different time instances, and an imaging device coupled with the projector, to generate pairs of images (a first image of a pair from a first perspective, and a second image of the pair from a second perspective), of different portions of the scene in response to the projection of the light pattern on respective portions. The apparatus may include a processor coupled with the projector and the imaging device, to control the motion of the projector, and generate the depth image of the object in the scene, based on processing of the generated pairs of images of the portions of the scene. Other embodiments may be described and claimed.

First claim

What is claimed is:

1 . An apparatus for providing a depth image of an object in a scene, comprising:
a projector to perform a controlled steering of a light pattern on different portions of the scene at different time instances; an imaging device coupled with the projector, to generate pairs of images of the different portions of the scene in response to the projection of the light pattern on respective portions, wherein to generate pairs of images includes, for a portion of the scene, to acquire a first image of a pair from a first perspective, and acquire a second image of the pair from a second perspective, wherein the first and second perspectives are different perspectives; and a processor coupled with the projector and the imaging device, to control the steering of the light pattern, and generate the depth image of the object in the scene, based at least in part on processing of the generated pairs of images of the portions of the scene.

2 . The apparatus of claim 1 , wherein the apparatus further comprises an actuator coupled with the projector, wherein the processor is to operate the actuator to control motion of the projector to project the light pattern around the scene.

3 . The apparatus of claim 1 , wherein the imaging device comprises a first camera and a second camera disposed at a distance from and in a plane with the first camera, wherein the first and second perspectives are defined at least in part by the distance between the first and second cameras.

4 . The apparatus of claim 1 , wherein the imaging device comprises a camera, wherein the camera is to acquire one of the first or second images of the pair, and the processor is to generate another one of the first or second images of the pair, based at least in part on a position of the projector relative to the scene, at a time instance of a projection of the light pattern on a respective portion of the scene.

5 . The apparatus of claim 4 , wherein the camera includes an infrared (IR) camera.

6 . The apparatus of claim 1 , wherein the light pattern comprises one or more light spots.

7 . The apparatus of claim 1 , wherein the projector to project a light pattern on different portions of a scene at different time instances includes to move the projector to project the light pattern around the scene in a random fashion.

8 . The apparatus of claim 1 , wherein the processor is to process the generated pairs of images, wherein to process includes:
determine multiple light intensity values for an image element of a portion of the scene, for at least some generated image pairs that include the image element; identify corresponding locations for the image element in respective images of each image pair of the at least some generated image pairs; and generate at least a portion of the depth image of the object, based at least in part on the determined multiple intensity values and corresponding locations of the image element.

9 . The apparatus of claim 8 , wherein the image element includes one or more pixels of an image of the portion of the scene.

10 . The apparatus of claim 8 , wherein the projector to perform a controlled steering includes to cause the light pattern to move for a distance that is less than a size of the image element, between acquisition of two successive image pairs.

11 . The apparatus of claim 1 , wherein the processor is to process the generated pairs of images, wherein to process includes:
identify a feature of a portion of the scene in at least some first and second images of at least some image pairs; determine disparity value for the feature for each of the at least some image pairs; and generate at least a portion of the depth image of the object, based at least in part on the determined disparity values of the feature, wherein the feature comprises a set of predetermined light intensity values associated with an image element of the first or second image.

12 . The apparatus of claim 11 , wherein to identify a feature includes to:
retrieve a data set indicative of the feature from a memory accessible by the processor; and compare the retrieved feature data set with corresponding data sets associated with the first and second images of the portion of the scene.

13 . The apparatus of claim 11 , wherein the image element comprises a pixel, wherein the projector to perform a controlled steering includes to cause the light pattern to move for a distance that is less than a size of the pixel, between acquisition of two successive image pairs.

14 . The apparatus of claim 11 , wherein to process further includes to detect discontinuity for the feature, based at least in part on the disparity values.

15 . A computing device-implemented method for providing a depth image of an object in a scene, comprising:
causing, by a computing device, a projector to perform a controlled steering, to project a light pattern on different portions of the scene at different time instances; receiving, by the computing device, pairs of images of the different portions of the scene generated by an imaging device coupled with the projector, in response to the projection of the light pattern on respective portions, including, for a portion of the scene, receiving a first image of a pair acquired from a first perspective, and receiving a second image of the pair acquired from a second perspective, wherein the first and second perspectives are different perspectives; processing, by the computing device, the generated pairs of images of the portions of the scene; and generating, by the computing device, the depth image of the object in the scene, based at least in part on a result of the processing.

16 . The computing device-implemented method of claim 15 , wherein processing includes:
determining, by the computing device, multiple light intensity values for an image element of a portion of the scene, for at least some generated image pairs that include the image element; identifying, by the computing device, corresponding locations for the image element in respective images of each image pair of the at least some generated image pairs; and generating, by the computing device, at least a portion of the depth image of the object, based at least in part on the determined multiple intensity values and corresponding locations of the image element.

17 . The computing device-implemented method of claim 16 , wherein the image element includes one or more pixels of an image of the portion of the scene, wherein causing a projector to perform a controlled steering includes causing, by the computing device, the light pattern to move for a distance that is less than a size of the image element, between acquisition of two successive image pairs.

18 . The computing device-implemented method of claim 15 , wherein processing includes:
identifying, by the computing device, a feature of a portion of the scene in at least some first and second images of at least some image pairs; determining, by the computing device, disparity values for the feature for each of the at least some image pairs; and generating, by the computing device, at least a portion of the depth image of the object, based at least in part on the determined disparity values of the feature, wherein the feature comprises a set of predetermined light intensity values associated with an image element of the first or second image.

19 . The computing device-implemented method of claim 18 , wherein identifying a feature of a portion of the scene includes:
retrieving, by the comput

Assignees

• Intel Corp

Inventors

• Horesh Nizan

Classifications

• H04N23/56

  provided with illuminating means · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N13/271

  wherein the generated image signals comprise depth maps or disparity maps · CPC title

• H04N13/254

  in combination with electromagnetic radiation sources for illuminating objects · CPC title

• G01S7/4817

  relating to scanning · CPC title