Optics apparatus with detection of light rays received at different angles for output indicative of aliased views

Patent metadata

Field	Value
Publication number	US-9658443-B2
Application number	US-201414209777-A
Country	US
Kind code	B2
Filing date	Mar 13, 2014
Priority date	Mar 15, 2013
Publication date	May 23, 2017
Grant date	May 23, 2017

Abstract

Images are detected in a manner that addresses various challenges as discussed herein. As may be consistent with one or more embodiments, aspects are directed to an apparatus having sets of photosensors that detect light rays received at different angles from a specimen via a microlens array, with the light rays detected by each set of photosensors representing an aliased view of the specimen. An output indicative of aliased views of the specimen is provided. Certain embodiments further include a logic circuit that processes the output and generates a deconvolved volume image by combining aliased views of the specimen as detected by the photosensors.

First claim

What is claimed is:

1. An apparatus comprising:
objective lens;
a microlens array; and
a photosensor array including respective sets of photosensors configured and arranged to
detect light rays received at different angles from a specimen via the objective lens and microlens array, the light rays detected by each set of photosensors representing an aliased view of the specimen, and
provide an output indicative of aliased views of the specimen; and

a logic circuit configured and arranged with the photosensor array to reconstruct a deconvolved volume image of the specimen, including information indicative of at least one of position and depth in the specimen, by combining the aliased views detected by the sets of photosensors based upon overlapping light rays from the different angles in the volume, the logic circuit being configured and arranged to reconstruct the deconvolved volume image by using the light rays and an irregular overlapping pattern of the light rays to increase an effective spatial sampling rate of the light rays relative to an actual sampling rate at which the photosensor detects the light rays.

2. The apparatus of claim 1 , wherein the logic circuit is configured and arranged with the photosensor array to compute deconvolved volume images by, for each image, combining data indicative of ones of the detected light rays that correspond to aliased views of the specimen, based upon respective angles at which the ones of the detected light rays are received.

3. The apparatus of claim 1 , wherein the logic circuit is configured and arranged with the photosensor array to compute a deconvolved volume image of the specimen using data indicative of the detected light rays including at least one of optical aberrations, diffraction, and aliasing produced by at least one of the objective lens, microlens array, and photosensor array.

4. The apparatus of claim 1 , wherein the logic circuit is configured and arranged with the photosensor array to compute a deconvolved volume image of the specimen using data indicative of at least one of angular and spatial characteristics of the detected light rays.

5. The apparatus of claim 1 , wherein the photosensor array includes at least two photosensor arrays respectively configured and arranged to detect the light rays at the different angles using at least two light paths respectively including different microlenses in the microlens array.

6. The apparatus of claim 1 , wherein the logic circuit is configured and arranged to construct a deconvolved volume image using data provided by each of the photosensor arrays.

7. An apparatus comprising:
objective lens;
a microlens array; and
a photosensor array including respective sets of photosensors configured and arranged to
detect light rays received at different angles from a specimen via the objective lens and microlens array, the light rays detected by each set of photosensors representing an aliased view of the specimen, and
provide an output indicative of aliased views of the specimen; and

a logic circuit configured and arranged with the photosensor array to reconstruct a deconvolved volume image of the specimen, including information indicative of at least one of position and depth in the specimen, by combining the aliased views detected by the sets of photosensors based upon overlapping light rays from the different angles in the volume, the logic circuit being further configured and arranged with the photosensor array to encode a forward projection of the deconvolved volume image to a four-dimensional light field image that varies as a function of position and depth in the volume image.

8. An apparatus comprising:
objective lens;
a microlens array; and
a photosensor array including respective sets of photosensors configured and arranged to
detect light rays received at different angles from a specimen via the objective lens and microlens array, the light rays detected by each set of photosensors representing an aliased view of the specimen, and
provide an output indicative of aliased views of the specimen; and

a logic circuit configured and arranged with the photosensor array to reconstruct a deconvolved volume image of the specimen, including information indicative of at least one of position and depth in the specimen, by combining the aliased views detected by the sets of photosensors based upon overlapping light rays from the different angles in the volume, and the logic circuit being further configured and arranged with the photosensor array to increase, by combining data indicative of overlapping light rays, an effective spatial sampling rate of the deconvolved volume image up to a limit set by the diffraction of light and the effective spatial and angular sampling rate of the apparatus.

9. An apparatus comprising:
respective sets of photosensors configured and arranged to
detect light rays received at different angles from a specimen via different microlenses, the light rays detected by each set of photosensors representing an aliased view of the specimen, and
provide an output indicative of aliased views of the specimen; and

a logic circuit connected to the photosensors and to receive the output indicative of the aliased views of the specimen, the logic circuit being configured and arranged to reconstruct a deconvolved volume image of the specimen by combining the aliased views detected by the sets of photosensors based upon overlapping light rays from the different angles in the volume, and angles at which the respective light rays are received at the photosensors; and
wherein the logic circuit is configured and arranged to reconstruct the deconvolved volume image by using the light rays and an irregular overlapping pattern of the light rays to increase an effective spatial sampling rate of the light rays relative to an actual sampling rate at which the photosensor detects the light rays.

10. An apparatus comprising:
objective lens;
a microlens array; and
a photosensor array including respective sets of photosensors configured and arranged to
detect light rays received at different angles from a specimen via the objective lens and microlens array, the light rays detected by each set of photosensors representing an aliased view of the specimen, and
provide an output indicative of aliased views of the specimen; and

a logic circuit configured and arranged with the photosensor array to reconstruct a deconvolved volume image of the specimen, including information indicative of at least one of position and depth in the specimen, by combining the aliased views detected by the sets of photosensors based upon overlapping light rays from the different angles in the volume and further configured and arranged to reconstruct the deconvolved volume image by using the overlapping light rays to mitigate out of focus characteristics of the respective images upon reconstruction of the deconvolved volume image by combining respective out of focus images detected by each of the photosensors, wherein images detected by each set of photosensors are out of focus.

11. An apparatus comprising:
objective lens;
a microlens array;
a photosensor array including respective sets of photosensors configured and arranged to
detect light rays received at different angles from a specimen via the objective lens and microlens array, the light rays detected by each set of photosensors representing an aliased view of the specimen, and
provide an output indicative of aliased views of the specimen; and

a logic circuit configured and arranged with the photosensor array to reconstruct a deconvolved volume image of the specimen, including information indicative of at least one of position and dept

Assignees

• Univ Leland Stanford Junior

Inventors

• Broxton Michael J
• Levoy Marc S
• Cohen Noy
• Grosenick Logan
• Yang Samuel
• Deisseroth Karl A

Classifications

• H04N23/95

  Computational photography systems, e.g. light-field imaging systems · CPC title

• G02B21/367 Primary

  providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison · CPC title

• G02B27/0075

  with means for altering, e.g. increasing, the depth of field or depth of focus · CPC title

• H04N5/225

  Electricity · mapped topic

• H04N13/0232

  Electricity · mapped topic