Autofocus with an angle-variable illumination

Patent metadata

Field	Value
Publication number	US-10955653-B2
Application number	US-201916367789-A
Country	US
Kind code	B2
Filing date	Mar 28, 2019
Priority date	Mar 28, 2018
Publication date	Mar 23, 2021
Grant date	Mar 23, 2021

Abstract

Various aspects of the invention relate to techniques to facilitate autofocus techniques for a test object by means of an angle-variable illumination. Here, image datasets are captured at a multiplicity of angle-variable illumination geometries. The captured image datsets are evaluated in order to determine the Z-position.

First claim

What is claimed is:

1. A method for operating a microscope, said method comprising:
capturing at least one image dataset in a multiplicity of angle-variable illumination geometries,
on the basis of control data indicative for a priori knowledge, carrying out a separation of a reproduction of a test object from interference structures in the at least one image dataset,
on the basis of the separation, recognizing components in the at least one image dataset that change in relation to a change in the angle-variable illumination geometry as an object shift of the test object,
on the basis of the object shift, determining a defocus position of the test object, and
on the basis of the defocus position, setting a Z-position of a specimen stage of the microscope.

2. The method according to claim 1 ,
wherein the a priori knowledge comprises at least one direction of the object shift in the at least one image dataset.

3. The method according to claim 2 , further comprising:
carrying out a correlation of the at least one image dataset, and
selecting data points of the correlation that correspond to the at least one direction of the object shift,
wherein the object shift is recognized on the basis of the selected data points.

4. The method according to claim 3 , further comprising:
selecting first data points of the correlation that correspond to a first direction of the at least one direction,
selecting second data points of the correlation that correspond to a second direction of the at least one direction, and
superimposing the first data points and the second data points,
wherein the object shift is recognized on the basis of the first and second data points that were selected and superimposed.

5. The method according to claim 2 , further comprising:
determining the at least one direction of the object shift on the basis of a relative positioning of light sources of an illumination module of the microscope,
wherein the light sources are associated with a multiplicity of angle-variable illumination geometries.

6. The method according to claim 1 ,
wherein the a priori knowledge comprises a search region for the object shift.

7. The method according to claim 6 ,
wherein capturing the at least one image dataset in the multiplicity of variable-angle illumination geometries and, associated therewith, setting the Z-position is carried out repeatedly for a multiplicity of iterations, and
wherein the a priori knowledge comprises the search region as a function of the iteration.

8. The method according to claim 6 ,
wherein the a priori knowledge comprises the search region for different depth-of-field ranges of an imaging optical unit of the microscope.

9. The method according to claim 1 ,
wherein the a priori knowledge comprises at least one of reproduction positions of the interference structures or a reproduction position of the test object in the at least one image dataset.

10. The method according to claim 9 , further comprising:
depending on the reproduction positions of the interference structures, applying tiling to the at least one image dataset, and
suppressing an evaluation of the at least one image dataset in image dataset tiles of the tiling that contain the interference structures.

11. The method according to claim 1 ,
wherein the a priori knowledge comprises at least one of a contrast of the interference structures or a contrast of the reproduction of the test object in the at least one image dataset.

12. The method according to claim 11 , further comprising:
carrying out a correlation of the at least one image dataset,
recognizing at least one correlation maximum in the correlation, and
on the basis of the contrast of the interference structures, discarding the at least one correlation maximum.

13. The method according to claim 1 ,
wherein the a priori knowledge comprises a real space periodicity of the test object.

14. The method according to claim 1 , further comprising:
receiving the control data from at least one of a user interface of the microscopy or a trained classifier, which operates on the at least one image dataset.

15. A method for operating a microscope, said method comprising:
capturing at least one image dataset in a multiplicity of angle-variable illumination geometries,
capturing a multiplicity of reference image datasets in a multiplicity of Z-positions of a specimen stage of the microscope,
recognizing components in the multiplicity of reference image datasets that are static in relation to a variation of the Z-position, as interference structures,
carrying out a separation of a reproduction of a test object from the interference structures that were recognized in the at least one image dataset,
on the basis of the separation, recognizing components in the at least one image dataset that change in relation to a change in the angle-variable illumination geometry, as an object shift of the test object,
on the basis of the object shift, determining a defocus position of the test object, and
on the basis of the defocus position, setting a Z-position of a specimen stage of the microscope.

16. The method according to claim 15 , wherein the method further comprises:
carrying out a correlation of the at least one image dataset,
carrying out a correlation of the multiplicity of reference image datasets, and
comparing the correlation of the at least one image dataset with the correlation of the multiplicity of reference image datasets,
wherein the interference structures are recognized on the basis of the comparing.

17. The method according to claim 16 ,
wherein capturing the at least one image dataset in the multiplicity of angle-variable illumination geometries and, associated therewith, setting the Z-position is carried out repeatedly for a multiplicity of iterations,
wherein the multiplicity of reference image datasets for a subsequent iteration of the multiplicity of iterations is obtained on the basis of the at least one image dataset of one or more preceding iterations of the multiplicity of iterations.

18. A method for operating a microscope, wherein the method, for each iteration of a multiplicity of iterations, comprises:
capturing at least one image dataset in a multiplicity of angle-variable illumination geometries;
recognizing components in the at least one image dataset that change in relation to a change in the angle-variable illumination geometry, as an object shift of a test object;
on the basis of the object shift, determining a defocus position of the test object; and
on the basis of the defocus position, setting a Z-position of a specimen stage of the microscope,
wherein the method further comprises:
adapting the multiplicity of angle-variable illumination geometries between successive iterations of the multiplicity of iterations.

19. The method according to claim 18 ,
wherein the multiplicity of angle-variable illumination geometries are adapted such that at least one of a direction of the object shift or a magnitude of the object shift per unit length of the defocus position is changed.

20. A method for operating a microscope,
wherein the method, for each iteration of a multiplicity of iterations, comprises:
capturing at least one image dataset in a multiplicity of angle-variable illumination geometries;
recognizing components in the at least one image dataset that change in relation to a change in the angle-variable illumination geometry, as an object shift of a test object;
on the basis of the o

Assignees

• Zeiss Carl Microscopy Gmbh
• Cad Zeiss Microscopy GmbH

Inventors

• Stoppe Lars
• Ohrt Thomas
• Dietrich Christian
• Sticker Markus

Classifications

• G02B21/244

  using image analysis techniques · CPC title

• G02B21/365

  Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence) · CPC title

• G01N21/8806

  Specially adapted optical and illumination features · CPC title

• G02B21/245 Primary

  using auxiliary sources, detectors · CPC title

• G06T7/586

  from multiple light sources, e.g. photometric stereo · CPC title