Sub-diffraction imaging, coding and decoding of non-bleaching scatters

Patent metadata

Field	Value
Publication number	US-11327018-B2
Application number	US-201917047124-A
Country	US
Kind code	B2
Filing date	Apr 12, 2019
Priority date	Apr 13, 2018
Publication date	May 10, 2022
Grant date	May 10, 2022

Abstract

An image reconstruction method includes capturing a reference image of the specimen and capturing a set of original images based on the reference image. The method includes generating a set of analyzed images based on the set of original images by determining an intensity distribution for each pixel of each original image of the set of original images and combining the intensity distribution at each pixel location across the set of original images into an intermediate image. The method includes, identifying an object in the intermediate image. In response to identifying the object in the intermediate image, determining an intensity value of the object in each original image of the set of original images and generating an improved image of the object based on the determined intensity value of the object. The method includes generating a final image including the improved image of the object and displaying the final image.

First claim

What is claimed is:

1. An image reconstruction method, comprising:
capturing a reference image of the specimen;
capturing a set of original images based on the reference image, where each original image of the set of original images has a corresponding amplitude, phase, and polarization;
generating a set of analyzed images based on the set of original images by determining an intensity distribution for each pixel of each original image of the set of original images and combining the intensity distribution at each pixel location across the set of original images into an intermediate image;
identifying an object in the intermediate image; and
in response to identifying the object in the intermediate image:
determining an intensity value of the object in each original image of the set of original images;
generating an improved image of the object based on the determined intensity value of the object;
generating a final image including the improved image of the object; and
displaying the final image.

2. The image reconstruction method of claim 1 , further comprising:
determining the intensity value of the object in response to the intermediate image being greater than a predetermined similarity threshold to the reference image.

3. The image reconstruction method of claim 1 wherein generating the set of analyzed images includes:
identifying pixel intensities of a plurality of pixels in each original image across the set of original images;
calculating the intensity distribution for each pixel of the plurality of pixels of each original image of the set of original images to generate the set of analyzed images; and
generating the intermediate image by, for each pixel of the plurality of pixels, combining the calculated intensity at each pixel across each analyzed image of the set of analyzed images.

4. The image reconstruction method of claim 3 wherein the intensity distributions are background-free and noise-free.

5. The image reconstruction method of claim 3 , wherein each analyzed image of the set of analyzed images includes, at each pixel location of a selected analyzed image, the intensity distribution of the pixel corresponding to the object location in the original image.

6. The image reconstruction method of claim 3 , wherein obtaining the intensity distribution includes applying an optimization algorithm to each pixel of the plurality of pixels.

7. The image reconstruction method of claim 6 wherein the optimization algorithm is a fast-iterative shrinkage-thresholding algorithm.

8. The image reconstruction method of claim 1 , wherein the set of original images is captured by adjusting a voltage of a voltage tunable polarizer and capturing each original image of the set of original images at a transmission polarization direction corresponding to the voltage.

9. The image reconstruction method of claim 1 , wherein the corresponding amplitude, phase, and polarization of each original image of the original images is captured by adjusting the amplitude and the phase using a spatial light.

10. The image reconstruction method of claim 1 , wherein a highest intensity value of the object indicates a resolved object, and where the final image includes an image of each object at the amplitude, phase, and polarization where the object is resolved.

11. The image reconstruction method of claim 1 , wherein, in response to the intermediate image being less than a predetermined similarity threshold to the reference image, displaying the intermediate image.

12. The image reconstruction method of claim 1 , further comprising analyzing the intermediate image by identifying a highest intensity of each object based on a difference in the intensity value between each original image of the set of original images and combining the corresponding original image of the set of original images having the highest intensity of each object into the intermediate image to generate the final image.

13. A photographic imaging system, comprising:
a camera that captures images of objects of interest;
a voltage-tunable polarizer disposed in light path of the camera, wherein, in response to a voltage applied thereto, the voltage-tunable polarizer changes polarization state of light propagating therethrough without mechanical rotation of the voltage-tunable polarizer itself;
a controller operably coupled to the voltage-tunable polarizer to supply voltage to the voltage-tunable polarizer; and
a processor and associated memory for storing instructions that, upon execution, cause the processor to:
capture a reference image of the specimen;
capture a set of original images based on the reference image, where each original image of the set of original images has a corresponding amplitude, phase, and polarization;
generate a set of analyzed images based on the set of original images by determining an intensity distribution for each pixel of each original image of the set of original images and combining the intensity distribution at each pixel location across the set of original images into an intermediate image;
identifying an object in the intermediate image; and
in response to identifying the object in the intermediate image:
determine an intensity value of the object in each original image of the set of original images;
generate an improved image of the object based on the determined intensity value of the object;
generate a final image including the improved image of the object; and
display the final image.

14. The photographic imaging system of claim 13 , wherein the instructions, upon execution, cause the processor to:
determine the intensity value of the object in response to the intermediate image being greater than a predetermined similarity threshold to the reference image.

15. The photographic imaging system of claim 13 , wherein the instructions, upon execution, cause the processor to:
generate the set of analyzed images by:
identifying pixel intensities of a plurality of pixels in each original image across the set of original images;
calculating the intensity distribution for each pixel of the plurality of pixels of each original image of the set of original images to generate the set of analyzed images; and
generating the intermediate image by, for each pixel of the plurality of pixels, combining the calculated intensity at each pixel across each analyzed image of the set of analyzed images.

16. The photographic imaging system of claim 13 , wherein the set of original images is captured by adjusting the voltage of the voltage tunable polarizer and capturing each original image of the set of original images at a transmission polarization direction corresponding to the voltage.

17. The photographic imaging system of claim 13 , wherein the corresponding amplitude, phase, and polarization of each original image of the original images is captured by adjusting the amplitude and the phase using a spatial light.

18. The photographic imaging system of claim 13 , wherein a highest intensity value of the object indicates a resolved object, and where the final image includes an image of each object at the amplitude, phase, and polarization where the object is resolved.

19. The photographic imaging system of claim 13 , wherein, in response to the intermediate image being less than a predetermined similarity threshold to the reference image, displaying the intermediate image.

20. The photographic imaging system of claim 13 , further comprising analyzing the intermediate image by identifying a highest intensity of

Assignees

• Univ Michigan Regents

Inventors

• Lee Somin Eunice
• Liu Yunbo
• Wang Yipei

Classifications

• H04N19/90

  using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals · CPC title

• G01N21/6428

  Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" (in vivo A61B5/00; immunoassay G01N33/53) · CPC title

• G02B21/367

  providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison · CPC title

• G01N21/6445

  Measuring fluorescence polarisation · CPC title

• G06T5/50 Primary

  using two or more images, e.g. averaging or subtraction · CPC title