Camera and specimen alignment to facilitate large area imaging in microscopy

Patent metadata

Field	Value
Publication number	US-11099368-B2
Application number	US-202016915057-A
Country	US
Kind code	B2
Filing date	Jun 29, 2020
Priority date	Feb 10, 2017
Publication date	Aug 24, 2021
Grant date	Aug 24, 2021

Abstract

A microscope system and method allow for a desired x′-direction scanning along a specimen to be angularly offset from an x-direction of the XY translation stage, and rotates an image sensor associated with the microscope to place the pixel rows of the image sensor substantially parallel to the desired x′-direction. The angle of offset of the x′-direction relative to the x-direction is determined and the XY translation stage is employed to move the specimen relative to the image sensor to different positions along the desired x′-direction without a substantial shift of the image sensor relative to the specimen in a y′-direction, the y′-direction being orthogonal to the x′ direction of the specimen. The movement is based on the angle of offset.

First claim

What is claimed is:

1. A method for imaging a specimen along a desired x′-direction of the specimen, the method comprising:
identifying a first feature of the specimen and a second feature of the specimen;
determining an angle of offset based on the first feature and the second feature;
rotating an image sensor, based on the angle of offset, such that pixel rows of the image sensor are substantially parallel with a desired x′-direction of the specimen positioned on an XY translation stage; and
moving the specimen, using the XY translation stage, to one or more positions, along the desired x′-direction.

2. The method of claim 1 , wherein determining the angle of offset comprises:
placing the first feature so as to overlap with one or more target pixels of the image sensor,
moving the specimen to place the second feature so as to overlap with the one or more target pixels, and
determining an x distance and y distance by measuring a magnitude of x and y movement of the XY translation stage (ΔX, ΔY) necessary to achieve the moving the specimen to place the second feature so as to overlap with the one or more target pixels.

3. The method of claim 2 , wherein the one or more target pixels encompass a center of the image sensor.

4. The method of claim 2 , wherein the rotating the image sensor comprises identifying an axis-defining feature on the specimen running in the desired x′-direction, and using computer vision to align the pixel rows substantially parallel to the axis-defining feature.

5. The method of claim 4 , wherein the rotating the image sensor is performed before measuring the x distance and y distance.

6. The method of claim 1 , wherein the rotating the image sensor comprises taking a mosaic of images suitable for calculating a reference line between the first feature and the second feature on the specimen aligned along and defining the desired x′-direction; and
using computer vision to align the pixel rows of the image sensor with the reference line.

7. The method of claim 6 , wherein the determining the angle of offset comprises:
measuring, relative to an x-direction and a y-direction of the XY translation stage, an x distance and y distance between the first feature and the second feature, and taking the mosaic of images while measuring the x distance and y distance.

8. The method of claim 1 , further comprising aligning the pixel rows of the image sensor substantially parallel to an x-direction of the XY translation stage, before rotating the image sensor.

9. The method of claim 8 , wherein the rotating the image sensor comprises:
identifying an axis-defining feature on the specimen, the axis-defining feature having a detectable shape running in the desired x′-direction; and
using computer vision to align the pixel rows substantially parallel to the detectable shape, and wherein the determining the angle of offset includes:
measuring degrees of rotation of the pixel rows of the image sensor from a position substantially parallel to the x-direction of the XY translation stage to a position substantially parallel to the detectable shape of the axis-defining feature.

10. A microscope system comprising:
a microscope;
an image sensor comprising pixel rows and pixel columns that is configured to record image data;
an XY translation stage that is movable in an X direction and a Y direction; and
a processor configured to:
identify a first feature of a specimen and a second feature of the specimen;
determine an angle of offset based on the first feature and the second feature;
rotate the image sensor, based on the angle of offset, relative to the specimen such that the pixel rows are substantially parallel with an x′-direction of the specimen placed on the XY translation stage; and
scan across the specimen in the x′-direction.

11. The microscope system of claim 10 , wherein determining the angle of offset comprises:
placing the first feature so as to overlap with one or more target pixels of the image sensor;
moving the specimen to place the second feature so as to overlap with the one or more target pixels; and
determining an x distance and a y distance by measuring a magnitude of x and y movement of the XY translation stage (ΔX, ΔY) necessary to achieve the moving the specimen to place the second feature so as to overlap with the one or more target pixels.

12. The microscope system of claim 11 , wherein the one or more target pixels encompass a center of the image sensor.

13. The microscope system of claim 11 , wherein the rotating the image sensor comprises:
identifying an axis-defining feature on the specimen running in the x′-direction; and
using computer vision to align the pixel rows substantially parallel to the axis-defining feature.

14. The microscope system of claim 13 , wherein rotating the image sensor is performed before measuring the x distance and the y distance.

15. The microscope system of claim 10 , wherein the rotating the image sensor comprises:
taking a mosaic of images suitable for calculating a reference line between the first feature and the second feature on the specimen aligned along and defining the x′-direction; and
using computer vision to align the pixel rows of the image sensor with the reference line.

16. The microscope system of claim 15 , wherein the taking a mosaic of images is performed while measuring an x distance and a y distance.

17. The microscope system of claim 10 , wherein, before the rotating the image sensor, the processor is configured to align the pixel rows of the image sensor substantially parallel to an x-direction of the XY translation stage.

18. The microscope system of claim 17 , wherein the rotating the image sensor includes:
identifying an axis-defining feature on the specimen, the axis-defining feature having a detectable shape running in the x′-direction; and
using computer vision to align the pixel rows substantially parallel to the detectable shape, and
wherein the determining the angle of offset includes:
measuring degrees of rotation of the pixel rows of the image sensor from a position substantially parallel to the x-direction of the XY translation stage to a position substantially parallel to the detectable shape of the axis-defining feature.

Assignees

• Nanotronics Imaging Inc

Inventors

• Putman Matthew C
• Putman John B
• Scott Brandon
• Fashbaugh Dylan

Classifications

• G02B21/26 Primary

  Stages; Adjusting means therefor · CPC title

• G02B21/002 Primary

  Scanning microscopes (scanning near field optical microscopes G01Q60/18) · CPC title

• G06V20/693

  Acquisition · CPC title

• G02B21/362

  Mechanical details, e.g. mountings for the camera or image sensor, housings (G02B21/364 takes precedence) · CPC title

• H04N1/3876

  Recombination of partial images to recreate the original image · CPC title