Extraction of microscope zoom level using object tracking

Patent metadata

Field	Value
Publication number	US-10409051-B2
Application number	US-201715643170-A
Country	US
Kind code	B2
Filing date	Jul 6, 2017
Priority date	Aug 2, 2016
Publication date	Sep 10, 2019
Grant date	Sep 10, 2019

Abstract

A method and system for extracting the zoom level of a microscope is disclosed. The method includes capturing a reference image; recording a first zoom level corresponding to a first magnification at which the reference image is captured; capturing a second image; determining a second zoom level by comparing the second image and the reference image, the second zoom level corresponding to a second magnification at which the second image is captured; and recording the second zoom level at a location accessible by a microscope application.

First claim

The invention claimed is:

1. A method for extracting the zoom level of a microscope, comprising:
capturing a plurality of reference images;
recording a first zoom level corresponding to a first magnification at which each reference image is captured;
capturing a second image;
determining a second zoom level by comparing the second image and each reference image and by using a common object of each reference image and the second image, the second zoom level corresponding to a second magnification at which the second image is captured, the determining the second zoom level comprising:
measuring a first size of the common object in each of the plurality of reference images;
measuring a second size of the common object in the second image;
selecting one of the plurality of reference images where the first size of the common object is closest to the second size of the common object; and
determining the second zoom level based on the difference in the first size of the common object in the selected one of the plurality of reference images and the second size; and

recording the second zoom level at a location accessible by a microscope application.

2. The method of claim 1 , wherein the common object contrasts with a surrounding portion of at least one of a reference image of the plurality of reference images and the second image.

3. The method of claim 1 , further comprising storing the second image as an additional reference image.

4. The method of claim 1 , wherein each reference image is captured at a predetermined zoom level.

5. A method for extracting the zoom level of a microscope, comprising:
capturing a plurality of reference images;
recording a first zoom level corresponding to a first magnification at which each reference image is captured;
capturing a second image;
determining a second zoom level by comparing the second image and each reference image and by using a common object of each reference image and the second image, the second zoom level corresponding to a second magnification at which the second image is captured, the determining the second zoom level comprising:
identifying a common object in each of the plurality of reference images and the second image;
measuring a size of the common object in each of the plurality of reference images;
measuring a second size of the common object in the second image;
determining a plurality of relative second zoom levels based on the difference in the size of the common object in each of the plurality of reference images and the second size; and
averaging the plurality of relative second zoom levels to determine the second zoom level; and

recording the second zoom level at a location accessible by a microscope application.

6. The method of claim 5 , wherein averaging the plurality of relative second zoom levels to determine the second zoom level includes performing a weighted average calculation of the plurality of relative second zoom levels to determine the second zoom level.

7. A method for extracting the zoom level of a microscope, comprising:
capturing a plurality of reference images;
recording a first zoom level corresponding to a first magnification at which each reference image is captured;
capturing a second image;
determining a second zoom level by comparing the second image and each reference image and by using a common object of each reference image and the second image, the second zoom level corresponding to a second magnification at which the second image is captured, the determining the second zoom level comprising:
identifying a common object in each of the plurality of reference images and the second image;
measuring a size of the common object in each of the plurality of reference images;
measuring a second size of the common object in the second image;
determining a plurality of relative second zoom levels based on the difference in the size of the common object in each of the plurality of reference images and the second size; and
using the median value of the plurality of relative second zoom levels to determine the second zoom level; and

recording the second zoom level at a location accessible by a microscope application.

8. A system for extracting the zoom level of a microscope, comprising:
a processor;
a non-transitory machine-readable medium communicatively coupled to the processor; and
instructions stored on the non-transitory machine-readable medium, the instructions, when loaded and executed by the processor, cause the processor to:
capture a plurality of reference images;
record a first zoom level corresponding to a first magnification at which each reference image is captured;
capture a second image;
determine a second zoom level by comparing the second image and each reference image and by using a common object of each reference image and the second image, the second zoom level corresponding to a second magnification at which the second image is captured, the determining the second zoom level comprising:
measuring a first size of the common object in each of the plurality of reference images;
measuring a second size of the common object in the second image;
selecting one of the plurality of reference images where the first size of the common object is closest to the second size of the common object; and
determining the second zoom level based on the difference in the first size of the common object in the selected one of the plurality of reference images and the second size; and

record the second zoom level at a location accessible by a microscope application.

9. The system of claim 8 , wherein the common object contrasts with a surrounding portion of at least one of a reference image of the plurality of reference images and the second image.

10. The system of claim 8 , the instructions further configured to store the second image as an additional reference image.

11. The system of claim 8 , wherein each reference image is captured at a predetermined zoom level.

12. A system for extracting the zoom level of a microscope, comprising:
a processor;
a non-transitory machine-readable medium communicatively coupled to the processor; and
instructions stored on the non-transitory machine-readable medium, the instructions, when loaded and executed by the processor, cause the processor to:
capture a plurality of reference images;
record a first zoom level corresponding to a first magnification at which each reference image is captured;
capture a second image;
determine a second zoom level by comparing the second image and each reference image and by using a common object of each reference image and the second image, the second zoom level corresponding to a second magnification at which the second image is captured, the determining the second zoom level comprising:
identifying a common object in each of the plurality of reference images and the second image;
measuring a size of the common object in each of the plurality of reference images;
measuring a second size of the common object in the second image;
determining a plurality of relative second zoom levels based on the difference in the size of the common object in each of the plurality of reference images and the second size; and
averaging the plurality of relative second zoom levels to determine the second zoom level; and

record the second zoom level at a location accessible by a microscope application.

13. The system of claim 12 , wherein averaging the plurality of relative second zoom levels to determine the second zoom level includes performing a weighted average calculation of the plurality of relative second zoom levels to determine the second z

Assignees

• Novartis Ag

Inventors

• Ren Hugang
• Yu Lingfeng
• Heeren Tammo

Classifications

• G02B21/0012

  Surgical microscopes (counterbalanced structures for surgical microscopes G02B7/001) · CPC title

• G06T2207/30041

  Eye; Retina; Ophthalmic · CPC title

• G06T7/80

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title