Automatic hemorrhage expansion detection from head CT images

Patent metadata

Field	Value
Publication number	US-11861835-B2
Application number	US-202117211927-A
Country	US
Kind code	B2
Filing date	Mar 25, 2021
Priority date	Mar 25, 2021
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

Systems and methods for assessing expansion of an abnormality are provided. A first input medical image of a patient depicting an abnormality at a first time and a second input medical image of the patient depicting the abnormality at a second time are received. The second input medical image is registered with the first input medical image. The abnormality is segmented from 1) the first input medical image to generate a first segmentation map and 2) the registered second input medical image to generate a second segmentation map. The first segmentation map and the second segmentation map are combined to generate a combined map. Features are extracted from the first input medical image and the registered second input medical image are based on the combined map. Expansion of the abnormality is assessed based on the extracted features using a trained machine learning based network. Results of the assessment are output.

First claim

The invention claimed is:

1. A computer-implemented method comprising:
receiving 1) a first input medical image of a patient depicting an abnormality at a first time and 2) a second input medical image of the patient depicting the abnormality at a second time;
registering the second input medical image with the first input medical image;
segmenting the abnormality from a) the first input medical image to generate a first segmentation map and b) the registered second input medical image to generate a second segmentation map;
combining the first segmentation map and the second segmentation map to generate a combined map;
extracting features from the first input medical image and the registered second input medical image based on regions in which the abnormality is located, wherein the regions are identified by the combined map;
assessing expansion of the abnormality based on the extracted features using a trained machine learning based network; and
outputting results of the assessment.

2. The computer-implemented method of claim 1 , wherein the abnormality comprises a hemorrhage.

3. The computer-implemented method of claim 1 , wherein extracting features from the first input medical image and the registered second input medical image based on regions in which the abnormality is located comprises:
generating an input image based on the first input medical image, the registered second input medical image, and the combined map;
extracting 2D in-plane features from slices of the generated input image; and
extracting out-of-plane features from the extracted 2D in-plane features.

4. The computer-implemented method of claim 3 , wherein assessing expansion of the abnormality based on the extracted features using a trained machine learning based network comprises:
determining an expansion score based on the extracted out-of-plane features.

5. The computer-implemented method of claim 4 , wherein assessing expansion of the abnormality based on the extracted features using a trained machine learning based network further comprises:
comparing the expansion score to one or more threshold values.

6. The computer-implemented method of claim 3 , wherein generating an input image based on the first input medical image, the registered second input medical image, and the combined map comprises:
generating a 3-channel input image comprising the first input medical image, the registered second input medical image, and the combined map.

7. The computer-implemented method of claim 3 , wherein the extracting the 2D in-plane features is performed using a first trained machine learning based feature extraction network and the extracting the out-of-plane features is performed using a second trained machine learning based feature extraction network, and the trained machine learning based network, the first trained machine learning based feature extraction network, and the second trained machine learning based feature extraction network are jointly trained.

8. The computer-implemented method of claim 1 , wherein combining the first segmentation map and the second segmentation map to generate a combined map comprises:
applying a voxelwise OR operation to the first segmentation map and the second segmentation map to generate the combined map.

9. The computer-implemented method of claim 1 , wherein the first input medical image and the second input medical image are CT (computed tomography) images of a head of the patient.

10. An apparatus comprising:
means for receiving 1) a first input medical image of a patient depicting an abnormality at a first time and 2) a second input medical image of the patient depicting the abnormality at a second time;
means for registering the second input medical image with the first input medical image;
means for segmenting the abnormality from a) the first input medical image to generate a first segmentation map and b) the registered second input medical image to generate a second segmentation map;
means for combining the first segmentation map and the second segmentation map to generate a combined map;
means for extracting features from the first input medical image and the registered second input medical image based on regions in which the abnormality is located, wherein the regions are identified by the combined map;
means for assessing expansion of the abnormality based on the extracted features using a trained machine learning based network; and
means for outputting results of the assessment.

11. The apparatus of claim 10 , wherein the abnormality comprises a hemorrhage.

12. The apparatus of claim 10 , wherein the means for extracting features from the first input medical image and the registered second input medical image based on regions in which the abnormality is located comprises:
means for generating an input image based on the first input medical image, the registered second input medical image, and the combined map;
means for extracting 2D in-plane features from slices of the generated input image; and
means for extracting out-of-plane features from the extracted 2D in-plane features.

13. The apparatus of claim 12 , wherein the means for assessing expansion of the abnormality based on the extracted features using a trained machine learning based network comprises:
means for determining an expansion score based on the extracted out-of-plane features.

14. The apparatus of claim 13 , wherein the means for assessing expansion of the abnormality based on the extracted features using a trained machine learning based network further comprises:
means for comparing the expansion score to one or more threshold values.

15. A non-transitory computer readable medium storing computer program instructions, the computer program instructions when executed by a processor cause the processor to perform operations comprising:
receiving 1) a first input medical image of a patient depicting an abnormality at a first time and 2) a second input medical image of the patient depicting the abnormality at a second time;
registering the second input medical image with the first input medical image;
segmenting the abnormality from a) the first input medical image to generate a first segmentation map and b) the registered second input medical image to generate a second segmentation map;
combining the first segmentation map and the second segmentation map to generate a combined map;
extracting features from the first input medical image and the registered second input medical image based on regions in which the abnormality is located, wherein the regions are identified by the combined map;
assessing expansion of the abnormality based on the extracted features using a trained machine learning based network; and
outputting results of the assessment.

16. The non-transitory computer readable medium of claim 15 , wherein extracting features from the first input medical image and the registered second input medical image based on regions in which the abnormality is located comprises:
generating an input image based on the first input medical image, the registered second input medical image, and the combined map;
extracting 2D in-plane features from slices of the generated input image; and
extracting out-of-plane features from the extracted 2D in-plane features.

17. The non-transitory computer readable medium of claim 16 , wherein generating an input image based on the first input medical image, the registered second input medical image, and the combined map comprises:
generating a 3-channel input image comprising the first input medical image, the re

Assignees

• Siemens Healthcare Gmbh

Inventors

• Yoo Youngjin
• Re Thomas
• Gibson Eli
• Chekkoury Andrei

Classifications

• G06T7/0014 Primary

  using an image reference approach · CPC title

• G06T7/11

  Region-based segmentation · CPC title

• G06T7/30

  Determination of transform parameters for the alignment of images, i.e. image registration · CPC title

• G06T2207/10081

  Computed x-ray tomography [CT] · CPC title

• G06T2207/20081

  Training; Learning · CPC title