Systems and methods for validating and correcting automated medical image annotations

Patent metadata

Field	Value
Publication number	US-10049093-B2
Application number	US-201514970995-A
Country	US
Kind code	B2
Filing date	Dec 16, 2015
Priority date	Sep 25, 2013
Publication date	Aug 14, 2018
Grant date	Aug 14, 2018

Abstract

Systems and methods are disclosed for manipulating image annotations. One method includes receiving an image of an individual's anatomy; automatically determining, using a processor, one or more annotations for anatomical features identified in the image of the individual's anatomy; determining a dependency or hierarchy between at least two of the one or more annotations for anatomical features identified in the image of the individual's anatomy; and generating, based on the dependency or hierarchy, a workflow prompting a user to manipulate the one or more annotations for anatomical features identified in the image of the individual's anatomy.

First claim

The invention claimed is:

1. A computer-implemented method of manipulating medical image annotations, the method comprising:
receiving an image of at least a portion of an individual's anatomy;
using a computer processor for automatically determining a first annotation of an anatomical feature identified in the image;
presenting to the user an electronic display of the first annotation;
prompting the user to input into the computer processor one or more responses to validation requests for verifying the first annotation;
accessing a sequence of dependencies between segmented portions of the image, the sequence of dependencies having been defined prior to receiving the image;
identifying a second annotation for an anatomical feature identified in the image, the second annotation following the first annotation according to the defined sequence of dependencies, wherein the sequence of dependencies is defined such that an identification of the second annotation is based on the validation of the first annotation;
presenting to the user an electronic display of the second annotation for the anatomical feature identified in the image upon verification of or modification to the first annotation via the one or more validation requests, the presentation of the second annotation being subsequent to the presentation of the first annotation according to the sequence of dependencies; and
generating, using a processor, a validated model of the individual's anatomy based on one or more user interactions with the one or more validation requests.

2. The method of claim 1 , further comprising:
generating a validated segmentation, wherein the validated model of the individual's anatomy is based on the validated segmentation; and
identifying one or more critical regions of the validated segmentation.

3. The method of claim 2 , further comprising:
preparing a rendering of the one or more critical regions of the validated segmentation; and
prompting an approval or modification for the one or more critical regions.

4. The method of claim 3 , further comprising:
creating the validated model of the individual's anatomy based on the approval or the modification for the one or more critical regions of the validated segmentation.

5. The method of claim 1 , further comprising:
determining one or more subsequent annotations based on the sequence of dependencies.

6. The method of claim 1 , further comprising:
determining one or more modifications to the first annotation or the second annotation; and
determining a re-computation of one or more subsequent annotations based on the one or more modifications.

7. The method of claim 6 , further comprising:
producing one or more visualizations associated with the first annotation, the second annotation, or the one or more subsequent annotations.

8. The method of claim 1 , wherein the sequence of dependencies is based on an aorta segmentation, left ventricle myocardium segmentation, and then a vessel lumen segmentation.

9. A computer system for manipulating medical image annotations, the system comprising:
a data storage device storing instructions for manipulating medical image annotations; and
a processor configured to execute the instructions to perform a method including:
receiving an image of at least a portion of an individual's anatomy;
using a computer processor for automatically determining a first annotation of an anatomical feature identified in the image;
presenting to the user an electronic display of the first annotation;
prompting the user to input into the computer processor one or more responses to validation requests for verifying the first annotation;
accessing a sequence of dependencies between segmented portions of the image, the sequence of dependencies having been defined prior to receiving the image;
identifying a second annotation for an anatomical feature identified in the image, the second annotation following the first annotation according to the defined sequence of dependencies, wherein the sequence of dependencies is defined such that an identification of the second annotation is based on the validation of the first annotation;
presenting to the user an electronic display of the second annotation for the anatomical feature identified in the image upon verification of or modification to the first annotation via the one or more validation requests, the presentation of the second annotation being subsequent to the presentation of the first annotation according to the sequence of dependencies; and
generating, using a processor, a validated model of the individual's anatomy based on one or more user interactions with the one or more validation requests.

10. The system of claim 9 , wherein the system is further configured for:
generating a validated segmentation, wherein the validated model of the individual's anatomy is based on the validated segmentation; and
identifying one or more critical regions of the validated segmentation.

11. The system of claim 10 , wherein the system is further configured for:
preparing a rendering of the one or more critical regions of the validated segmentation; and
prompting an approval or modification for the one or more critical regions.

12. The system of claim 11 , wherein the system is further configured for:
creating the validated model of the individual's anatomy based on the approval or the modification for the one or more critical regions of the validated segmentation.

13. The system of claim 9 , wherein the system is further configured for:
determining one or more subsequent annotations based on the sequence of dependencies.

14. The system of claim 9 , wherein the system is further configured for:
determining one or more modifications to the first annotation or the second annotation; and
determining a re-computation of one or more subsequent annotations based on the one or more modifications.

15. The system of claim 14 , wherein the system is further configured for:
producing one or more visualizations associated with the first annotation, the second annotation, or the one or more subsequent annotations.

16. The system of claim 9 , wherein the sequence of dependencies is based on an aorta segmentation, left ventricle myocardium segmentation, and then a vessel lumen segmentation.

17. A non-transitory computer readable medium for use on a computer system containing computer-executable programming instructions for performing a method of manipulating medical image annotations, the method comprising:
receiving an image of at least a portion of an individual's anatomy;
using a computer processor for automatically determining a first annotation of an anatomical feature identified in the image;
presenting to the user an electronic display of the first annotation;
prompting the user to input into the computer processor one or more responses to validation requests for verifying the first annotation;
accessing a sequence of dependencies between segmented portions of the image, the sequence of dependencies having been defined prior to receiving the image;
identifying a second annotation for an anatomical feature identified in the image, the second annotation following the first annotation according to the defined sequence of dependencies, wherein the sequence of dependencies is defined such that an identification of the second annotation is based on the validation of the first annotation;
presenting to the user an electronic display of the second annotation for the anatomical feature identified in the image upon verification of or modification to

Assignees

• Heartflow Inc

Inventors

• Grady Leo J
• Moreau-Gobard Romain
• Schaap Michiel

Classifications

• G06T7/0012

  Biomedical image inspection · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06T19/003

  Navigation within 3D models or images · CPC title

• G06T19/00

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• G06T2219/004

  Annotating, labelling · CPC title