Click based contour editing

Patent metadata

Field	Value
Publication number	US-12141420-B2
Application number	US-202217960367-A
Country	US
Kind code	B2
Filing date	Oct 5, 2022
Priority date	Oct 5, 2022
Publication date	Nov 12, 2024
Grant date	Nov 12, 2024

Abstract

Click based contour editing includes detecting a selection input with respect to an image presented on a graphical user interface; designating an area of the image corresponding to the selection input as a region of interest; detecting at least one other selection input on the graphical user interface with respect to the image; determining if the at least one other selection input is within the region of interest or outside of the region of interest; and if the at least one other selection input is within the region of interest, excluding the portion of the image corresponding to the other input; or if the other selection input is outside of the region of interest, including the portion of the image corresponding to an area of the image associated with the other selection input.

First claim

The invention claimed is:

1. A contour editing method comprising:
detecting a selection input with respect to a medical image presented on a graphical user interface, wherein the medical image depicts an organ;
determining and presenting a bounding box around a region of interest in the medical image based on the selection input;
determining a contour of the organ within the bounding box;
detecting at least one other selection input on the graphical user interface with respect to the medical image, wherein the at least one other selection input includes a single click or a single tap;
adjusting the contour of the organ by determining if the at least one other selection input is within the contour of the organ or outside of the contour of the organ, wherein:
(1) if the at least one other selection input is within the contour of the organ, the adjustment comprises:
removing a portion of the medical image associated with the at least one other selection input from the contour of the organ; and
decreasing one or more dimensions of the bounding box to exclude the portion of the medical image associated with the at least one other selection input;

(2) if the at least one other selection input is outside of the contour of the organ, the adjustment comprises:
adding the portion of the medical image associated with the at least one other selection input to the contour of the organ; and
increasing one or more dimensions of the bounding box to include the portion of the medical image associated with the at least one other selection input;

detecting another user input that indicates a movement of a point associated with the adjusted contour of the organ; and
refining the contour of the organ based on the movement of the point.

2. The contour editing method of claim 1 , wherein, if the at least one other selection input is outside of the contour of the organ, the method further comprising:
detecting, via the graphical user interface, a selection of an area of the medical image within the contour of the organ adjusted based on the at least one other selection input;
detecting, via the graphical user interface, a movement of the selection on the graphical user interface; and
repositioning the selected area of the medical image based on the movement of the selection.

3. The contour editing method of claim 1 , wherein determining and presenting the bounding box around the region of interest based on the detected selection input comprises:
determining a point in the medical image that corresponds to the detected selection input;
determining a size and a shape of the bounding box based on the point that corresponds to the detected selection input such that the bounding box includes the point; and
displaying the bounding box as a visibly distinguishable region from other regions of the medical image.

4. The contour editing method of claim 3 , wherein the bounding box has a rectangular shape and the contour of the organ has a polygonal shape or a freeform shape.

5. The contour editing method of claim 1 , further comprising determining a point of the medical image that corresponds to the at least one other selection input, and highlighting the point in a first color if the point is inside the contour of the organ or highlighting the point in a second color if the point is outside of the contour of the organ.

6. The contour editing method of claim 1 , wherein the medical image is a magnetic resonance imaging (MRI) image, and wherein the organ is associated with a heart.

7. The contour editing method of claim 1 , wherein the bounding box is a three-dimensional bounding box.

8. The contour editing method of claim 1 , wherein the at least one other selection input includes a single touch input.

9. The contour editing method of claim 1 , wherein the contour of the organ has one of a circular shape, an elliptical shape, a rectangular shape, a polygonal shape, a freeform shape, a spherical shape, an ellipsoid, a cuboidal shape, a polygonal prism shape, a polygonal pyramid shape, a freeform prism shape, or a freeform pyramid shape.

10. A system comprising a hardware processor configured to render a graphical user interface, wherein the hardware processor is further configured to:
detect a selection input with respect to a medical image presented on the graphical user interface, wherein the medical image depicts an organ;
determine and present a bounding box around a region of interest in the medical image based on the selection input;
determine a contour of the organ within the bounding box;
detect at least one other selection input on the graphical user interface with respect to the medical image, wherein the at least one other selection input includes a single click or a single tap;
adjust the contour of the organ by determining if the at least one other selection input is within the contour of the organ or outside of the contour of the organ, wherein:
(1) if the at least one other selection input is within the contour of the organ, the hardware processor is configured to:
remove a portion of the medical image associated with the at least one other selection input from the contour of the organ; and
decrease one or more dimensions of the bounding box to exclude the portion of the medical image associated with the at least one other selection input;

(2) if the at least one other selection input is outside of the contour of the organ, the hardware processor is configured to:
add the portion of the medical image associated with the at least one other selection input to the contour of the organ; and
increase one or more dimensions of the bounding box to include the portion of the medical image associated with the at least one other selection input;

detect another user input that indicates a movement of a point associated with the adjusted contour of the organ; and
refine the contour of the organ based on the movement of the point.

11. The system of claim 10 , wherein, if the at least one other selection input is outside of the contour of the organ, the hardware processor is further configured to:
detect, via the graphical user interface, a selection of an area of the medical image within the contour of the organ adjusted based on the at least one other selection input;
detect, via the graphical user interface, a movement of the selection on the graphical user interface; and
reposition the selected area of the medical image based on the movement of the selection.

12. The system of claim 10 , wherein the hardware processor being configured to determine and present the bounding box around the region of interest based on the detected selection input comprises the hardware processor being configured to:
determine a point in the medical image that corresponds to the detected selection input;
determine a size and a shape of the bounding box based on the point that corresponds to the detected selection input such that the bounding box includes the point; and
display the bounding box as a visibly distinguishable region from other regions of the medical image.

13. The system of claim 12 , wherein the bounding box has a rectangular shape and the contour of the organ has a polygonal shape or a freeform shape.

14. The system of claim 1 , wherein the hardware processor is further configured to determine a point of the medical image that corresponds to the at least one other selection input, and highlight the point in a first color if the point is inside the contour of the organ or highlight the point in a second color if the point is outside of the contour of the organ.

15. The system of claim 10 , wherein

Assignees

• Shanghai United Imaging Intelligence Co Ltd

Inventors

• Innanje Arun
• Peng Zheng
• Wu Ziyan
• Liu Qin
• Chen Terrence

Classifications

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G06T2210/12

  Bounding box · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T2210/22

  Cropping · CPC title

• G06T7/12

  Edge-based segmentation · CPC title