System, method and computer-accessible medium for quantification of blur in digital images

Patent metadata

Field	Value
Publication number	US-12100191-B2
Application number	US-202318455096-A
Country	US
Kind code	B2
Filing date	Aug 24, 2023
Priority date	Aug 30, 2016
Publication date	Sep 24, 2024
Grant date	Sep 24, 2024

Abstract

The present disclosure discusses systems and methods to detect blur in digital images. The solution can be incorporated into the quality control systems of pathology and other slide scanners or can be a stand-alone solution. The solution can identify scanned images that include blur and cause the scanner to automatically rescan the blurry image. The solution can also identify regions of the scanned image that include blur. The solution can generate blur maps for each of the scanned images that identify regions of the scanned image that include blur.

First claim

What is claimed is:

1. A system for processing electronic medical images, the system comprising:
at least one memory storing instructions; and
at least one processor executing the instructions to perform operations comprising:
generating a plurality of patches from a digital image, each patch of the plurality of patches including a plurality of pixels, the digital image being of a pathology slide;
determining, for each patch of the plurality of patches, values according to one or more sharpness metrics;
determining, using a patch classifier, a blur score for each patch of the plurality of patches, the blur score of the patch being determined using the determined values of the one or more sharpness metrics of the patch, wherein the patch classifier utilizes a neural network to make the determination;
flagging each patch in a group of the plurality of patches having the blur score above a predetermined threshold; and
determining a blur map based on the blur score for each patch of the plurality of patches, and based on the flagged patches.

2. The system of claim 1 , the operations further comprising:
determining the blur score for each of the plurality of patches with one of a random forest regression algorithm or a logistic regression algorithm.

3. The system of claim 1 , the operations further comprising:
determining, using the patch classifier, the blur score for each of the plurality of patches with a residual neural network.

4. The system of claim 1 , the operations further comprising:
a background detector to discard a patch that comprises background data.

5. The system of claim 1 , wherein a portion of a first of the plurality of patches overlaps a portion of a second of the plurality of patches.

6. The system of claim 1 , the operations further comprising:
determining a plurality of values for each patch in the group of the plurality of patches.

7. The system of claim 1 , wherein the one or more sharpness metrics comprise at least one pixel intensity-based feature, gradient-based feature, transform-based feature, and perceptual-based feature.

8. The system of claim 1 , wherein the one or more sharpness metrics comprise a variance metric, a range histogram metric, an entropy histogram metric, a Mason and Green's histogram metric, a Mendelsohn and Mayall's histogram metric, a gradient metric, a sum of modified laplacian metric, a Tenengrad metric, a blur metric in a frequency domain, a DCT blur metric, a Haar wavelet transform metric, a Marziliano metric, and a cumulative probability of blur detection metric.

9. The system of claim 1 , the operations further comprising:
converting, using a background detector, the image to a grayscale image.

10. A method for detecting a quantity of blur in images, comprising:
generating, by a blur detector including a software and one or more processors, a plurality of patches from a digital image, each patch of the plurality of patches including a plurality of pixels the digital image being of a pathology slide;
determining, by the blur detector, for each patch of the plurality of patches, values according to one or more sharpness metrics;
determining, by the blur detector, a blur score for each patch of the plurality of patches, the blur score of the patch being determined using the determined values of the one or more sharpness metrics of the patch, wherein the blur detector utilizes a neural network;
flagging each patch in the group of the plurality of patches having the blur score above a predetermined threshold; and
generating, by the blur detector, a blur map based on the blur score for each patch of the plurality of patches and based on the flagged patches.

11. The method of claim 10 , further comprising:
determining, by the blur detector, the blur score for each of the plurality of patches with one of a random forest regression algorithm or a logistic regression algorithm.

12. The method of claim 10 , further comprising:
determining, by the blur detector, the blur score for each of the plurality of patches with a residual neural network.

13. The method of claim 10 , further comprising discarding, by the blur detector, a patch that comprises background data.

14. The method of claim 10 , wherein a portion of a first of the plurality of patches overlaps a portion of a second of the plurality of patches.

15. The method of claim 10 , further comprising:
determining, by the blur detector, a plurality of values for each patch in the group of the plurality of patches.

16. The method of claim 10 , wherein the one or more sharpness metrics comprise at least one pixel intensity-based feature, gradient-based feature, transform-based feature, or perceptual-based feature.

17. The method of claim 10 , wherein the one or more sharpness metrics comprise a variance metric, a range histogram metric, an entropy histogram metric, a Mason and Green's histogram metric, a Mendelsohn and Mayall's histogram metric, a gradient metric, a sum of modified laplacian metric, a Tenengrad metric, a blur metric in a frequency domain, a DCT blur metric, a Haar wavelet transform metric, a Marziliano metric, or a cumulative probability of blur detection metric.

18. The method of claim 10 , further comprising converting the image to a grayscale image.

19. A method for detecting a quantity of blur in images, comprising:
generating, by a blur detector including a software and one or more processors, a plurality of patches from a digital image, each patch of the plurality of patches including a plurality of pixel, the digital image being of a pathology slide;
determining, by the blur detector, for each patch of the plurality of patches, values according to one or more sharpness metrics;
determining, by the blur detector, a blur score for each patch of the plurality of patches, the blur score of the patch being determined using the determined values of the one or more sharpness metrics of the patch, wherein the blur detector utilizes a neural network;
flagging, by the blur detector, each patch in a group of the plurality of patches having the blur score above a predetermined threshold; and
generating, by the blur detector, a blur map based on the blur score for each patch of the plurality of patches.

Assignees

• Memorial Sloan Kettering Cancer Center

Inventors

• Campanella Gabriele
• Schüffler Peter J
• Fuchs Thomas

Classifications

• G06F18/2415

  based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate · CPC title

• G06V20/695

  Preprocessing, e.g. image segmentation · CPC title

• G06V10/30 Primary

  Noise filtering · CPC title