Optical systems and methods supporting diverse optical and computational functions

Patent metadata

Field	Value
Publication number	US-10404908-B2
Application number	US-201615739868-A
Country	US
Kind code	B2
Filing date	Jun 15, 2016
Priority date	Jul 13, 2015
Publication date	Sep 3, 2019
Grant date	Sep 3, 2019

Abstract

An imaging system includes multiple diffractive optical gratings disposed over a two-dimensional array of photosensitive pixels. The different gratings present different patterns and features that are tailored to produce point-spread responses that emphasize different properties of an imaged scene. The different responses are captured by the pixels, and data captured from the responses can be used separately or together to analyze aspects of the scene. The imaging systems can include circuitry to analyze the image data, and to support modes that select between point-spread responses, selections of the pixels, and algorithms for analyzing image data.

First claim

What is claimed is:

1. A system for imaging a scene, the system comprising:
at least one photodetector array having a first region of pixels and a second region of pixels;
a first phase grating overlying the first region of pixels, the first phase grating and the first region of pixels collectively exhibiting a first impulse response, the first region of pixels to sample first image data modulated by the first phase grating and representing the scene;
a second phase grating overlying the second region of pixels, the second phase grating and the second region of pixels exhibiting a second impulse response different from the first impulse response, the second region of pixels to sample second image data modulated by the second phase grating and representing the scene; and
circuitry to perform a first computational function on the first image data and a second computational function different from the first computational function on the second image data.

2. The system of claim 1 , wherein first phase grating and the second phase grating exhibit the same point-source response.

3. The system of claim 2 , further comprising a microlens array between the photodetector array and both of the first phase grating and the second phase grating.

4. The system of claim 3 , the microlens array including first microlenses over the first region of pixels and exhibiting a first collective microlens response and second microlenses over the second region of pixels and exhibiting a second collective microlens response different from the first collective microlens response.

5. The system of claim 1 , wherein the first phase grating includes first boundaries of odd symmetry and the second phase grating includes second boundaries of odd symmetry shaped differently than the first boundaries of odd symmetry.

6. The system of claim 1 , wherein the first phase grating is geometrically similar to the second phase grating.

7. The system of claim 6 , wherein the at least one photodetector array includes rows and columns of pixels, and wherein the first phase grating is rotated angularly about an axis perpendicular to the rows and columns of pixels.

8. The system of claim 6 , wherein the at least one photodetector array includes rows and columns of pixels, and wherein the first phase grating is scaled larger than the second phase grating in a dimension parallel to the rows and columns of pixels.

9. The system of claim 1 , wherein the first computational function transforms the first image data into first frequency-domain image data and the second computational function transforms the second image data into second frequency-domain image data.

10. The system of claim 9 , the circuitry to compute a frequency-domain estimate of the scene by combining the first frequency-domain image data, the second frequency-domain image data, the first impulse response, and the second impulse response.

11. The system of claim 10 , further comprising transforming the frequency-domain estimate into a pixel-domain image.

12. The system of claim 9 , the circuitry to compute a first partial image from the first frequency-domain image data and the first impulse response, to compute a second partial image from the second frequency-domain image data and the second impulse response, and to combine the first partial image with the second partial image.

13. The system of claim 1 , the circuitry to combine the first image data with the second image data and transform the combined image data into a frequency domain.

14. The system of claim 1 , further comprising a first filter overlying only one of the first region of pixels and the second region of pixels.

15. The system of claim 1 , the photodetector array to sample only one of the first image data and the second image data in a first mode and both the first image data and the second image data in a second mode.

16. The system of claim 15 , the circuitry to transition from the first mode to the second mode responsive to the first computational function.

17. A method for imaging a scene, the method comprising:
modulating first light from the scene using a first phase grating overlying a first region of pixels, the first phase grating and the first region of pixels collectively exhibiting a first impulse response;
sampling the modulated first light incident the first region of pixels to acquire first image data representing the scene;
modulating second light from the scene using a second phase grating overlying a second region of pixels, the second phase grating and the second region of pixels collectively exhibiting a second impulse response different from the first impulse response;
sampling the modulated second light incident the second region of pixels to acquire second image data representing the scene; and
perform a first computational function on the first image data and a second computational function different from the first computational function on the second image data.

18. The method of claim 17 , wherein the first computational function transforms the first image data into first frequency-domain image data and the second computational function transforms the second image data into second frequency-domain image data.

19. The method of claim 18 , further comprising computing a frequency-domain estimate of the scene by combining the first frequency-domain image data, the second frequency-domain image data, the first impulse response, and the second impulse response.

20. The method of claim 19 , further comprising transforming the frequency-domain estimate into a pixel-domain image.

21. The method of claim 18 , further comprising computing a first partial image from the first frequency-domain image data and the first impulse response, computing a second partial image from the second frequency-domain image data and the second impulse response, and combining the first partial image with the second partial image.

22. The method of claim 17 , further comprising combining the first image data with the second image data and transforming the combined image data into a frequency domain.

23. The method of claim 17 , further comprising sampling only one of the first image data and the second image data in a first mode and both the first image data and the second image data in a second mode.

24. The method of claim 23 , further comprising transitioning from the first mode to the second mode responsive to the first computational function.

Assignees

• Rambus Inc

Inventors

• Stork David G
• Gill Patrick R
• Erickson Evan L
• Kellam Mark D
• Schneider Alexander C
• Endsley Jay
• KABIR Salman

Classifications

• G06V10/761

  Proximity, similarity or dissimilarity measures · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G02B5/18

  Diffraction gratings {(holographic optical elements G02B5/32, G03H; integrally combined with optical fibres G02B6/02057; for coupling light guides G02B6/34; integrally combined with optical integrated light guides G02B6/12; grating systems G02B27/44)} · CPC title

• G02B2005/1804

  Transmission gratings · CPC title

• G02B3/0006

  Arrays (G02B3/02, G02B5/188 take precedence) · CPC title