Passive three-dimensional image sensing based on referential image blurring with spotted reference illumination

Patent metadata

Field	Value
Publication number	US-11831859-B2
Application number	US-202117315269-A
Country	US
Kind code	B2
Filing date	May 8, 2021
Priority date	May 8, 2020
Publication date	Nov 28, 2023
Grant date	Nov 28, 2023

Abstract

Techniques are described for passive three-dimensional image sensing based on referential image blurring. For example, a filter mask is integrated with a lens assembly to provide one or more normal imaging bandpass (NIB) regions and one or more reference imaging bandpass (RIB) regions, the regions being optically distinguishable and corresponding to different focal lengths and/or different focal paths. As light rays from a scene object pass through the different regions of the filter mask, a sensor can detect first and second images responsive to those light rays focused through the NIB region and the RIB region, respectively (according to their respective focal lengths and/or respective focal paths). An amount of blurring between the images can be measured and correlated to an object distance for the scene object. Some embodiments project additional reference illumination to enhance blurring detection in the form of reference illumination flooding and/or spotted illumination.

First claim

What is claimed is:

1. A passive three-dimensional imaging system comprising:
an illumination source to project spotted illumination onto a scene object, the spotted illumination comprising reference light components;
a lens assembly comprising:
a filter mask having a first reference imaging bandpass (RIB) region and a second RIB region spatially separated by a portion of a substrate such that the first and second RIB regions lie in spatially distinct regions along a filter plane of the filter mask; and
a lens configured to focus the reference light components as reflected off of the scene object through the filter mask, such that a first portion of the reference light components is focused onto a first image plane along a first path through the first RIB region, and a second portion of the reference light components is focused onto a second image plane along a second path through the second RIB region, the second image plane offset from the first image plane by an offset amount that changes as a function of an object distance of the scene object from the lens assembly;

an image sensor comprising a plurality of photodetector elements defining a detection plane and configured to detect a first image of the spotted illumination responsive to the first portion of the reference light components received by the plurality of photodetector elements after being focused through the filter mask, and to detect a second image of the spotted illumination responsive to the second portion of the reference light components received by the plurality of photodetector elements after being focused through the filter mask, the detection plane being removed from the filter plane; and
a processor configured to determine an object distance of the scene object based on determining a blurring value and a spatial separation between the first and second RIB regions, the blurring value indicating an amount of non-overlap between the first image and the second image due to the offset amount.

2. The system of claim 1 , wherein the illumination source is configured to scan the spotted illumination across at least a portion of the scene object to project the spotted illumination onto a plurality of locations of the scene object over a time window.

3. The system of claim 2 , wherein:
the image sensor is configured, at each of a plurality of frame times within the time window, to detect a respective first image and to detect a respective second image of the spotted illumination as projected onto a respective one of the plurality of locations of the scene object corresponding to the frame time; and
the processor is configured to determine multiple object distances for the scene object based on determining respective blurring value indicating spatial separation at the image sensor between each respective first image and each respective second image for at least a portion of the frame times.

4. The system of claim 1 , wherein the illumination source is to project the spotted illumination to form one or more elliptical spots of illumination of the scene object.

5. The system of claim 1 , wherein the illumination source is to project the spotted illumination to form one or more lines of illumination on the scene object by diffracting coherent source illumination.

6. The system of claim 1 , wherein the lens assembly is positionable relative to the image sensor, so that:
the blurring value indicates substantially no spatial separation at the image sensor between the first image and the second image responsive to the scene object being positioned at a calibration object distance; and
the blurring value indicates increasing spatial separation at the image sensor between the first image and the second image responsive to the scene object being increasing farther from the calibration object distance.

7. The system of claim 1 , wherein:
the lens comprises a plurality of lens components that define a common aperture plane; and
the filter mask is positioned to filter the reference light components substantially at the common aperture plane.

8. The system of claim 1 , wherein:
the filter mask further has a normal imaging bandpass (NIB) region separate and spaced away from the first and second RIB regions;
the first and second RIB regions are configured to permit passage of the reference light components and to impede passage of normal light components that are optically distinguishable from the reference light components; and
the NIB region is configured to permit passage of the normal light components and to impede passage of the reference light components.

9. The system of claim 8 , wherein:
the reference light components are in a reference illumination band;
the normal light components are in a normal illumination band different from the reference illumination band;
the RIB region is configured as an optical bandpass filter for the reference illumination band and as an optical bandstop filter for the normal illumination band; and
the NIB region is configured as an optical bandpass filter for the normal illumination band and as an optical bandstop filter for the reference illumination band.

10. The system of claim 9 , wherein:
one of the reference illumination band or the normal illumination band is in a human-visible portion of optical wavelengths; and
the other of the reference illumination band or the normal illumination band is outside the human-visible portion of optical wavelengths.

11. The system of claim 8 , wherein:
the lens is configured to focus the reference light components through the first and second RIB regions of the filter mask onto a reference image plane;
the lens is further configured to focus the normal light components through the NIB region of the filter mask onto a normal image plane;
the first image plane and the second image plane have positions that change as a function of the object distance;
the image sensor is further configured to detect a third image of the scene object responsive to detection of the normal light components; and
the processor is further configured to determine the object distance based on determining a blurring value indicating spatial separation at the image sensor between the third image and at least one of the first image or the second image.

12. The system of claim 8 , wherein:
the NIB region is a central inner region of the filter mask surrounded by an outer region of the filter mask; and
the outer region of the filter mask comprises the first and second RIB regions and substantially opaque regions separating at least the NIB region from the first and second RIB regions.

13. The system of claim 12 , wherein:
the lens assembly further comprises a mechanical aperture configured to operate in a normal aperture mode and a reference aperture mode, such that:
in the normal aperture mode, the mechanical aperture mechanically blocks passage of light through the first and second RIB regions while permitting passage of light through the NIB region; and
in the reference aperture mode, the mechanical aperture permits passage of light at least through the RIB region.

14. The system of claim 8 , wherein the normal light components are optically distinguishable from the reference light components based at least on relative polarization or respective intensity.

15. A method for passive three-dimensional imaging, the method comprising:
projecting spotted illumination onto a scene object, the spotted illumination comprising reference light components;
detecting a first image responsive to first reference light components interacting with an image sensor, the first reference light co

Assignees

• Shenzhen Goodix Tech Co Ltd

Inventors

• He Yi
• Pi Bo

Classifications

• H04N13/271 Primary

  wherein the generated image signals comprise depth maps or disparity maps · CPC title

• G02B5/003

  Light absorbing elements · CPC title

• G02B5/201

  in the form of arrays · CPC title

• G06T7/571

  from focus · CPC title

• H04N13/207

  using a single two-dimensional [2D] image sensor · CPC title