Medical imaging device and method of operating the same

Patent metadata

Field	Value
Publication number	US-10290097-B2
Application number	US-201615373613-A
Country	US
Kind code	B2
Filing date	Dec 9, 2016
Priority date	Jan 18, 2016
Publication date	May 14, 2019
Grant date	May 14, 2019

Abstract

A medical imaging device includes: a display configured to display first and second medical images having different modalities from each other with respect to an object: an image processor configured to match the first and second medical images, extract a second object corresponding to a first object selected in the first medical image from the second medical image, extract first feature information of the first object by analyzing the first medical image, and extract second feature information of the second object by analyzing the second medical image: and a controller configured to generate final diagnostic information based on the first and second feature information, and control the display to display the final diagnostic information.

First claim

What is claimed is:

1. A medical imaging device comprising:
a display configured to display first and second medical images having different modalities from each other with respect to an object;
an image processor; and
a memory configured to store instructions that, when executed by the image processor, cause the image processor to perform operations of:
matching the first and second medical images based on a geometric relationship between individual anatomical structures extracted from the first and second medical images;
receiving a selection of a first object in the first medical image based on a first input;
extracting a first boundary of the first object in the first medical image, and further extracting a second boundary of a second object corresponding to the first boundary of the first object from the second medical image matched with the first medical image;
receiving a second input correcting one of the first boundary in the first medical image and the second boundary in the second medical image;
correcting the one of the first boundary and the second boundary, and further correcting another of the first boundary and the second boundary based on the corrected boundary;
extracting first feature information including information used for diagnosing the first object by analyzing a corrected first medical image;
extracting second feature information including information used for diagnosing the second object by analyzing a corrected second medical image matched with the first medical image;
generating final diagnostic information of the object based on the first and second feature information; and
controlling the display to display the final diagnostic information.

2. The medical imaging device of claim 1 , wherein the instructions further cause the image processor to perform operations of:
acquiring first and second medical image data having different modalities from each other;
generating the first medical image based on the first medical image data; and
generating the second medical image based on the second medical image data.

3. The medical imaging device of claim 1 , wherein the instructions further cause the image processor to perform an operation of:
controlling the display to display the first and second boundaries.

4. The medical imaging device of claim 3 , wherein the instructions further cause the image processor to perform an operation of:
extracting the first and second feature information based on a third boundary calculated based on the first and second boundaries.

5. The medical imaging device of claim 4 , wherein the instructions further cause the image processor to perform an operation of:
controlling the display to display the third boundary.

6. The medical imaging device of claim 3 , wherein the instructions further cause the image processor to perform operations of:
controlling the display to display a list comprising at least one boundary candidate with respect to the first object, and
correcting the first and second boundaries based on a boundary candidate selected from the list.

7. The medical imaging device of claim 1 , wherein
the first feature information comprises at least one of information about a shape, a direction, an angle margin, a boundary of a lesion, calcification, an echo pattern, and a posterior acoustic feature of the first object, and
the second feature information comprises at least one of information about a shape, a direction, an angle margin, a boundary of a lesion, calcification, an echo pattern, and a posterior acoustic feature of the second object.

8. The medical imaging device of claim 1 , wherein the instructions further cause the image processor to perform an operation of:
determining whether the first object is benign or malignant based on the first and second feature information, and wherein
the final diagnostic information comprises information of whether the first object is benign or malignant.

9. The medical imaging device of claim 1 , wherein
the first and second medical images comprises at least one of ultrasound images, X-ray images, computed tomography (CT) images, magnetic resonance (MR) images, positron emission tomography (PET) images, PET/CT images, and PET/MR images.

10. A method of operating a medical imaging device, the method comprising:
displaying first and second medical images having different modalities from each other with respect to an object;
matching the first and second medical images based on a geometric relationship between individual anatomical structures extracted from the first and second medical images;
receiving a selection of a first object in the first medical image based on a first input;
extracting a first boundary of the first object in the first medical image, and further
extracting a second boundary of a second object corresponding to the first boundary of the first object from the second medical image matched with the first medical image;
receiving a second input correcting one of the first boundary in the first medical image and the second boundary in the second medical image;
correcting the one of the first boundary and the second boundary, and further correcting another of the first boundary and the second boundary based on the corrected boundary;
extracting first feature information including information used for diagnosing the first object by analyzing a corrected first medical image, and further extracting second feature information including information used for diagnosing the second object by analyzing a corrected second medical image matched with the first medical image;
generating final diagnostic information of the object based on the first and second feature information; and
displaying the final diagnostic information.

11. The method of claim 10 , further comprising:
acquiring first and second medical image data having different modalities from each other; and
generating the first medical image based on the first medical image data, and further generating the second medical image based on the second medical image data.

12. The method of claim 10 , further comprising:
displaying the first and second boundaries.

13. The method of claim 12 , further comprising:
calculating a third boundary based on the first and second boundaries, and
the extracting of the first and second feature information comprises extracting the first and second feature information based on the third boundary.

14. The method of claim 12 , further comprising:
displaying a list comprising at least one boundary candidate with respect to the first object; and
correcting the first and second boundaries based on a boundary candidate selected from the list.

15. The method of claim 10 , wherein
the generating of the final diagnostic information comprises:
determining whether the first object is benign or malignant based on the first and second feature information, wherein
the final diagnostic information comprises:
information of whether the first object is benign or malignant.

16. A non-transitory computer-readable recording medium having recorded thereon a program for executing a method of claim 10 .

Assignees

• Samsung Medison Co Ltd

Inventors

• Shin Dong-Kuk
• Park Sang-Cheol

Classifications

• G06V10/46 Primary

  Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features (colour feature extraction G06V10/56) · CPC title

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• G06V10/752

  Contour matching · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06K9/6204

  Physics · mapped topic