Predicting structured illumination parameters

Patent metadata

Field	Value
Publication number	US-11119302-B2
Application number	US-202017090775-A
Country	US
Kind code	B2
Filing date	Nov 5, 2020
Priority date	Jun 29, 2018
Publication date	Sep 14, 2021
Grant date	Sep 14, 2021

Abstract

Implementations of the disclosure are directed to predicting structured illumination parameters for a particular point in time, space, and/or temperature using estimates of structured illumination parameters obtained from structured illumination images captured by a structured illumination system. Particular implementations are directed to predicting structured illumination frequency, phase, orientation, and/or modulation order parameters.

First claim

What is claimed is:

1. A method, comprising:
capturing, at a structured illumination system, a first image of a sample;
estimating, at a computing device, using at least the captured first image, a first structured illumination parameter;
capturing, at the structured illumination system, a second image of the sample;
estimating, at the computing device, using at least the captured second image, a second structured illumination parameter; and
predicting, at the computing device, using at least the first structured illumination parameter or the second structured illumination parameter, a third structured illumination parameter, the third structured illumination parameter corresponding to a third image, wherein predicting the third structured illumination parameter comprises applying a least-squares fit to at least the first structured illumination parameter or the second structured illumination parameter.

2. The method of claim 1 , wherein:
the first image is captured at a first time;
the second image is captured at a second time after the first time;
the third image is captured at a third time between the first time and the second time; and
predicting the third structured illumination parameter comprises: predicting, using at least an interpolation method, the third structured illumination parameter at the third time.

3. The method of claim 1 further comprising:
determining, at the computing device, a rate of change from the first structured illumination parameter at the first time to the second structured illumination at the second time; and
predicting, at the computing device, using at least the determined rate of change, the third structured illumination parameter at the third time.

4. The method of claim 1 , further comprising: constructing, at the computing device, using at least the third image and the third structured illumination parameter, a high resolution image.

5. The method of claim 1 , wherein:
the first image is captured at a first time;
the second image is captured at a second time after the first time;
the third image is captured at a third time after both the first time and the second time; and
predicting the third structured illumination parameter comprises: predicting, using at least an extrapolation method, the third structured illumination parameter at the third time.

6. The method of claim 5 , further comprising: adjusting, using at least the third structured illumination parameter, a hardware component of the structured illumination system to compensate for changes in a structured illumination parameter prior to capturing the third image at the third time.

7. The method of claim 6 , wherein adjusting the hardware component comprises: adjusting a rotating mirror to adjust a phase or orientation of a structured illumination pattern; adjusting a translation stage carrying a diffraction grating to adjust a phase or orientation of a structured illumination pattern; or adjusting a sample translation stage to adjust a phase or orientation of a structured illumination pattern.

8. The method of claim 1 , further comprising:
storing in a memory of the structured illumination system: the first structured illumination parameter, the second structured illumination parameter, and the third structured illumination parameter; and
reducing, using one or more of the stored first structured illumination, the stored second structured illumination parameter, the stored third structured illumination parameter, or a stored value based on known physical characteristics of the structured illumination system, a search space for a fourth structured illumination parameter for a fourth image.

9. The method of claim 1 , wherein:
the first image of the sample is captured at a first sample temperature;
the first structured illumination parameter is estimated at the first sample temperature;
the second image of the sample is captured at a second sample temperature;
the second structured illumination parameter is estimated at the second sample temperature; and
predicting the third structured illumination parameter, comprises: predicting the third structured illumination parameter at a third sample temperature.

10. The method of claim 1 , further comprising:
dividing the first image of the sample into a plurality of image subsections;
estimating, at the computing device, using at least a first image subsection of the plurality of image subsections, a fourth structured illumination parameter;
estimating, at the computing device, using at least a second image subsection of the plurality of image subsections, a fifth structured illumination parameter; and
predicting, at the computing device, using at least the fourth structured illumination parameter or the fifth structured illumination parameter, a sixth structured illumination parameter corresponding to a third image subsection of the plurality of image subsections.

11. The method of claim 1 , further comprising:
dividing the first image of the sample into a plurality of image subsections;
estimating, at the computing device, using at least a first image subsection of the plurality of image subsections, a fourth structured illumination parameter; and
using the estimated fourth structured illumination parameter as a predicted structured illumination parameter of a second image subsection of the plurality of image subsections.

12. A non-transitory computer-readable medium having executable instructions stored thereon that, when executed by a processor, cause a structured illumination system to perform operations comprising:
capturing a first image of a sample;
estimating, using at least the captured first image, a first structured illumination parameter;
capturing a second image of the sample;
estimating, using at least the captured second image, a second structured illumination parameter; and
predicting, using at least the first structured illumination parameter or the second structured illumination parameter, a third structured illumination parameter corresponding to a third image, wherein predicting the third structured illumination parameter comprises applying a least-squares fit to at least the first structured illumination parameter or the second structured illumination parameter.

13. The non-transitory computer-readable medium of claim 12 , wherein:
the first image is captured at a first sample position;
the second image is captured at a second sample position;
the third image is captured at a third sample position between the first sample position and the second sample position; and
predicting the third structured illumination parameter comprises: predicting, using at least an interpolation method, the third structured illumination parameter at the third sample position.

14. The non-transitory computer-readable medium of claim 13 , wherein the interpolation method comprises:
determining a rate of change from the first structured illumination parameter at the first sample position to the second structured illumination parameter at the second sample position; and
predicting, using at least the determined rate of change, the third structured illumination parameter at the third sample position.

15. The non-transitory computer-readable medium of claim 12 , wherein the operations further comprise: constructing, using at least the third image and the third structured illumination parameter, a high resolution image.

16. The non-transitory computer-readable medium of claim 12 , wherein:
the first image is captured at a first sample position;
the second image is captured at a second sample position;

Assignees

• Illumina Inc

Inventors

• Carney Michael J
• Hong Stanley S
• Langlois Robert
• Ren Hongji
• Bartig Kevin Wayne
• Otto Rico
• Souverneva Olga Andreevna

Classifications

• G01B11/2513 Primary

  with several lines being projected in more than one direction, e.g. grids, patterns · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title

• G06T2207/10056

  Microscopic image · CPC title

• G06T7/11

  Region-based segmentation · CPC title

• G02B27/58

  Optics for apodization or superresolution; Optical synthetic aperture systems · CPC title