Real-time focusing in line scan imaging

Patent metadata

Field	Value
Publication number	US-12038568-B2
Application number	US-202217650221-A
Country	US
Kind code	B2
Filing date	Feb 7, 2022
Priority date	May 2, 2012
Publication date	Jul 16, 2024
Grant date	Jul 16, 2024

Abstract

Systems and methods for capturing a digital image of a slide using an imaging line sensor and a focusing line sensor. In an embodiment, a beam-splitter is optically coupled to an objective lens and configured to receive one or more images of a portion of a sample through the objective lens. The beam-splitter simultaneously provides a first portion of the one or more images to the focusing sensor and a second portion of the one or more images to the imaging sensor. A processor controls the stage and/or objective lens such that each portion of the one or more images is received by the focusing sensor prior to it being received by the imaging sensor. In this manner, a focus of the objective lens can be controlled using data received from the focusing sensor prior to capturing an image of a portion of the sample using the imaging sensor.

First claim

What is claimed is:

1. A system for capturing a digital image of a microscope slide, the system comprising:
an objective lens having an optical field of view and positioned at a first height;
an imaging line sensor positioned in a first optical path of the optical field of view;
a focusing line sensor positioned in a second optical path of the optical field of view; and
a hardware processor configured to:
obtain contrast information identifying a respective contrast for each pixel of an array of pixels associated with the focusing line sensor;
identify location information associated with the focusing line sensor based at least in part on the contrast information, the location information identifying a location of a particular pixel of the array of pixels relative to the other pixels, the location of the particular pixel being correlated with a unique height of the objective lens relative to the other pixels, the particular pixel being associated with a particular contrast;
determine a focus height of the objective lens based at least in part on the location of the particular pixel of the location information; and
cause movement of the objective lens from the first height to the focus height.

2. The system of claim 1 , wherein the hardware processor is further configured to determine the focus height further based at least in part on an optical magnification of the second optical path.

3. The system of claim 1 , wherein the hardware processor is further configured to determine the focus height further based at least in part on an angle of the focusing line sensor, wherein the focusing line sensor is tilted at the angle with respect to an axis that is perpendicular to the second optical path.

4. The system of claim 1 , wherein the hardware processor is further configured to image a first portion of the optical field of view using the imaging line sensor in response to causing movement of the objective lens from the first height to the focus height.

5. The system of claim 1 , further comprising a beam splitter that splits an optical path through the objective lens into the first optical path and the second optical path.

6. The system of claim 1 , wherein the hardware processor is further configured to during a single scan in one direction, for each of a plurality of positions on the microscope slide:
acquire image data of the position using the focusing line sensor;
obtain particular contrast information;
identify particular location information associated with the focusing line sensor based at least in part on the particular contrast information;
determine a particular focus height of the objective lens based at least in part on the particular location information; and
cause movement of the objective lens from an original height to the particular focus height.

7. The system of claim 1 , wherein the hardware processor is further configured to:
obtain updated contrast information;
identify updated location information associated with the focusing line sensor based at least in part on the updated contrast information;
determine an updated focus height of the objective lens based at least in part on the updated location information; and
cause movement of the objective lens from the focus height to the updated focus height.

8. The system of claim 1 , wherein the particular pixel is associated with a greater focus as compared to each other pixel of the array of pixels.

9. The system of claim 1 , wherein the particular pixel is associated with a higher contrast as compared to each other pixel of the array of pixels.

10. The system of claim 1 , wherein each pixel of the array of pixels is associated with a particular focus, wherein the particular pixel is associated with a best focus of focuses associated with the array of pixels.

11. The system of claim 1 , wherein the particular pixel is associated with a highest contrasts of contrasts associated with the array of pixels.

12. The system of claim 1 , wherein the hardware processor is further configured to:
compare a plurality of contrasts associated with the array of pixels; and
determine the particular pixel is associated with a highest contrast of the plurality of contrasts, wherein identifying the location information is based at least in part on determining the particular pixel is associated with the highest contrast.

13. The system of claim 1 , wherein, simultaneously:
the imaging line sensor acquires an image of the light from a first portion of the optical field of view; and
the focusing line sensor acquires an image of the light from a second portion of the optical field of view.

14. The system of claim 13 , wherein the first portion of the optical field of view follows the second portion of the optical field of view in a scanning direction.

15. The system of claim 14 , wherein the first portion of the optical field of view is in a center of the optical field of view, and wherein the second portion of the optical field of view is offset from the center of the optical field of view.

16. The system of claim 1 , wherein each pixel of the array of pixels corresponds to an image of a particular area of the digital image.

17. A method comprising:
by a hardware processor,
obtaining contrast information identifying a respective contrast for each pixel of an array of pixels associated with a focusing line sensor, wherein an imaging line sensor is positioned in a first optical path of an optical field of view of an objective lens and the focusing line sensor is positioned in a second optical path of the optical field of view of the objective lens;
identifying location information associated with the focusing line sensor based at least in part on the contrast information, the location information identifying a location of a particular pixel of the array of pixels relative to the other pixels, the location of the particular pixel being correlated with a unique height of the objective lens relative to the other pixels, the particular pixel being associated with a particular contrast;
determining a focus height of the objective lens based at least in part on the location of the particular pixel of the location information; and
causing movement of the objective lens from a first height to the focus height.

18. A linear sensor apparatus, the linear sensor apparatus comprising:
an objective lens having an optical field of view and positioned at a first height;
an imaging line sensor positioned in a first optical path of the optical field of view;
a focusing line sensor positioned in a second optical path of the optical field of view; and
a hardware processor configured to:
obtain contrast information identifying a respective contrast for each pixel of an array of pixels associated with the focusing line sensor;
identify location information associated with the focusing line sensor based at least in part on the contrast information, the location information identifying a location of a particular pixel of the array of pixels relative to the other pixels and a predetermined reference pixel, the location of the particular pixel being correlated with a unique height of the objective lens relative to the other pixels, the particular pixel being associated with a particular contrast;
determine a focus height of the objective lens based at least in part on the location of the particular pixel of the location information; and
cause movement of the objective lens from the first height to the focus height.

19. The linear sensor apparatus of claim 18 , wherein the hard

Assignees

• Leica Biosystems Imaging Inc

Inventors

• Zou Yunlu
• Crandall Gregory
• Olson Allen

Classifications

• G02B21/365

  Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence) · CPC title

• G02B21/361

  Optical details, e.g. image relay to the camera or image sensor (G02B21/364 takes precedence; illumination details G02B21/06 and subgroups) · CPC title

• G02B21/245

  using auxiliary sources, detectors · CPC title

• G02B21/006 Primary

  focusing arrangements; selection of the plane to be imaged · CPC title