Method and device for processing pathological slide image

Patent metadata

Field	Value
Publication number	US-11967076-B2
Application number	US-202318122837-A
Country	US
Kind code	B2
Filing date	Mar 17, 2023
Priority date	Mar 18, 2022
Publication date	Apr 23, 2024
Grant date	Apr 23, 2024

Abstract

A computing device includes at least one memory, and at least one processor configured to generate, based on first analysis on a pathological slide image, first biomarker expression information, generate, based on a user input for updating at least some of results of the first analysis, second biomarker expression information about the pathological slide image, and control a display device to output a report including medical information about at least some regions included in the pathological slide image, based on at least one of the first biomarker expression information or the second biomarker expression information.

First claim

What is claimed is:

1. A computing device comprising:
at least one memory; and
at least one processor configured to:
perform first analysis on a pathological slide image, by using a first machine learning model, to identify cell information about at least one cell expressed in the pathological slide image,
generate first biomarker expression information about the pathological slide image based on the cell information identified by the first machine learning model,
receive a user input for updating the cell information,
perform second analysis on the pathological slide image based on the user input to update the cell information,
generate second biomarker expression information about the pathological slide image based on the updated cell information, and
control a display device to output a report including medical information about at least some regions included in the pathological slide image, based on the second biomarker expression information,

wherein the user input is at least one of an input to add information about a staining expression level of the cell, an input to modify information about the staining expression level of the cell, or an input to delete information about the staining expression level of the cell.

2. The computing device of claim 1 , wherein
the second analysis is performed by a second machine learning model that is a machine learning model corresponding to the first machine learning model or a machine learning model obtained by updating the first machine learning model.

3. The computing device of claim 2 , wherein the second machine learning model is obtained by training the first machine learning model based on information obtained by modifying results of the first analysis according to the user input.

4. The computing device of claim 1 , wherein the first biomarker expression information and the second biomarker expression information are generated by a third machine learning model.

5. The computing device of claim 1 , wherein the user input comprises an input for updating results of the first analysis after a user confirms the results of the first analysis according to priorities that are set based on the first biomarker expression information.

6. The computing device of claim 1 , wherein the report comprises at least one of first medical information or second medical information,
wherein the first medical information is based on at least one of results of the first analysis, results of the second analysis, the first biomarker expression information, or the second biomarker expression information, and
wherein the second medical information is based on a result of comparing the first biomarker expression information with the second biomarker expression information.

7. The computing device of claim 1 , wherein the processor is further configured to, before performing the first analysis on the pathological slide image, verify the pathological slide image and perform anonymization on subject-identifiable information among information corresponding to the pathological slide image.

8. The computing device of claim 7 , wherein the processor is further configured to perform at least one of first verification on a staining method corresponding to the pathological slide image, second verification on metadata corresponding to the pathological slide image, or third verification on an image pyramid corresponding to the pathological slide image.

9. The computing device of claim 1 , wherein the processor is further configured to control the display device to output results of the first analysis and the first biomarker expression information.

10. The computing device of claim 1 , wherein the processor is further configured to control the display device to output the second biomarker expression information.

11. A method of processing a pathological slide image, the method comprising:
performing first analysis on a pathological slide image, by using a first machine learning model, to identify cell information about at least one cell expressed in the pathological slide image;
generating first biomarker expression information about the pathological slide image based on the cell information identified by the first machine learning model;
receiving a user input for updating the cell information;
performing second analysis on the pathological slide image based on the user input to update the cell information;
generating second biomarker expression information about the pathological slide image based on the updated cell information; and
outputting a report including medical information about at least some regions included in the pathological slide image, based on the second biomarker expression information,
wherein the user input is at least one of an input to add information about a staining expression level of the cell, an input to modify information about the staining expression level of the cell, or an input to delete information about the staining expression level of the cell.

12. The method of claim 11 , wherein
the second analysis is performed by a second machine learning model that is a machine learning model corresponding to the first machine learning model or a machine learning model obtained by updating the first machine learning model.

13. The method of claim 12 , wherein the second machine learning model is obtained by training the first machine learning model based on information obtained by modifying, according to the user input, results of the first analysis.

14. The method of claim 11 , wherein the first biomarker expression information and the second biomarker expression information are generated by a machine learning model.

15. The method of claim 11 , wherein the user input comprises an input for updating at least some of results of the first analysis after a user confirms the results of the first analysis according to priorities that are set based on the first biomarker expression information.

16. A non-transitory computer-readable recording medium having recorded thereon a program for causing a computer to execute the method of claim 11 .

Assignees

• Lunit Inc

Inventors

• Kang Jeong Seok
• Yoo Dong Geun
• Cho Soo Ick
• Jung Won Kyung

Classifications

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• G06V10/761

  Proximity, similarity or dissimilarity measures · CPC title

• G16H15/00

  ICT specially adapted for medical reports, e.g. generation or transmission thereof · CPC title

• G16H50/20

  for computer-aided diagnosis, e.g. based on medical expert systems · CPC title