Systems and methods for validating and correcting automated medical image annotations

Patent metadata

Field	Value
Publication number	US-2016104281-A1
Application number	US-201514970995-A
Country	US
Kind code	A1
Filing date	Dec 16, 2015
Priority date	Sep 25, 2013
Publication date	Apr 14, 2016
Grant date	—

Abstract

Systems and methods are disclosed for manipulating image annotations. One method includes receiving an image of an individual's anatomy; automatically determining, using a processor, one or more annotations for anatomical features identified in the image of the individual's anatomy; determining a dependency or hierarchy between at least two of the one or more annotations for anatomical features identified in the image of the individual's anatomy; and generating, based on the dependency or hierarchy, a workflow prompting a user to manipulate the one or more annotations for anatomical features identified in the image of the individual's anatomy.

First claim

1 - 20 . (canceled)

21 . A computer-implemented method of manipulating medical image annotations, the method comprising:
receiving an image of at least a portion of an individual's anatomy; using a computer processor for automatically determining a first annotation of an anatomical feature identified in the image of the individual's anatomy; prompting a user to input into the computer processor one or more responses to validation requests for verifying the first annotation; identifying, based on a preconfigured sequence between segmented portions of the image of the individual's anatomy, a second annotation for the anatomical feature following the first annotation; presenting to the user an electronic display of the second annotation for the anatomical feature identified in the image of the individual's anatomy upon verification of the first annotation received via the one or more validation requests; and generating, using a processor, a validated model of the individual's anatomy based on one or more user interactions with the one or more validation requests.

22 . The method of claim 21 , further comprising:
generating a validated segmentation, wherein the validated model of the individual's anatomy is based on the validated segmentation; and identifying one or more critical regions of the validated segmentation.

23 . The method of claim 22 , further comprising:
preparing a rendering of the one or more critical regions of the validated segmentation; and prompting an approval or modification for the one or more critical regions.

24 . The method of claim 23 , further comprising:
creating the validated model of the individual's anatomy based on the approval or the modification for the one or more critical regions of the validated segmentation.

25 . The method of claim 21 , further comprising:
determining one or more subsequent annotations included in the preconfigured order.

26 . The method of claim 21 , further comprising:
determining one or more modifications to the first annotation or the second annotation; and determining a re-computation of one or more subsequent annotations based on the one or more modifications.

27 . The method of claim 26 , further comprising:
producing one or more visualizations associated with the first annotation, the second annotation, or the one or more subsequent annotations.

28 . The method of claim 21 , wherein the preconfigured order is based on an aorta segmentation, left ventricle myocardium segmentation, and then a vessel lumen segmentation.

29 . A computer system for manipulating medical image annotations, the system comprising:
a data storage device storing instructions for manipulating medical image annotations; and a processor configured to execute the instructions to perform a method including:
receiving an image of at least a portion of an individual's anatomy;
using a computer processor for automatically determining a first annotation of an anatomical feature identified in the image of the individual's anatomy;
prompting a user to input into the computer processor one or more responses to validation requests for verifying the first annotation;
identifying, based on a preconfigured sequence between segmented portions of the image of the individual's anatomy, a second annotation for the anatomical feature following the first annotation;
presenting to the user an electronic display of the second annotation for the anatomical feature identified in the image of the individual's anatomy upon verification of the first annotation received via the one or more validation requests; and
generating, using a processor, a validated model of the individual's anatomy based on one or more user interactions with the one or more validation requests.

30 . The system of claim 29 , wherein the system is further configured for:
generating a validated segmentation, wherein the validated model of the individual's anatomy is based on the validated segmentation; and identifying one or more critical regions of the validated segmentation.

31 . The system of claim 30 , wherein the system is further configured for:
preparing a rendering of the one or more critical regions of the validated segmentation; and prompting an approval or modification for the one or more critical regions.

32 . The system of claim 31 , wherein the system is further configured for:
creating the validated model of the individual's anatomy based on the approval or the modification for the one or more critical regions of the validated segmentation.

33 . The system of claim 29 , wherein the system is further configured for:
determining one or more subsequent annotations included in the preconfigured order.

34 . The system of claim 29 , wherein the system is further configured for:
determining one or more modifications to the first annotation or the second annotation; and determining a re-computation of one or more subsequent annotations based on the one or more modifications.

35 . The system of claim 34 , wherein the system is further configured for:
producing one or more visualizations associated with the first annotation, the second annotation, or the one or more subsequent annotations.

36 . The system of claim 29 , wherein the preconfigured order is based on an aorta segmentation, left ventricle myocardium segmentation, and then a vessel lumen segmentation.

37 . A non-transitory computer readable medium for use on a computer system containing computer-executable programming instructions for performing a method of manipulating medical image annotations, the method comprising:
receiving an image of at least a portion of an individual's anatomy; using a computer processor for automatically determining a first annotation of an anatomical feature identified in the image of the individual's anatomy; prompting a user to input into the computer processor one or more responses to validation requests for verifying the first annotation; identifying, based on a preconfigured sequence between segmented portions of the image of the individual's anatomy, a second annotation for the anatomical feature following the first annotation; presenting to the user an electronic display of the second annotation for the anatomical feature identified in the image of the individual's anatomy upon verification of the first annotation received via the one or more validation requests; and generating, using a processor, a validated model of the individual's anatomy based on one or more user interactions with the one or more validation requests.

38 . The non-transitory computer readable medium of claim 37 , the method further comprising:
generating a validated segmentation, wherein the validated model of the individual's anatomy is based on the validated segmentation; and identifying one or more critical regions of the validated segmentation.

39 . The non-transitory computer readable medium of claim 38 , the method further comprising:
preparing a rendering of the one or more critical regions of the validated segmentation; and prompting an approval or modification for the one or more critical regions.

40 . The non-transitory computer readable medium of claim 39 , the method further comprising:
creating the validated model of the individual's anatomy based on the approval or the modification for the one or more critical regions of the validated segmentation.

Assignees

• Heartflow Inc

Inventors

• Grady Leo J
• Moreau-Gobard Romain
• Schaap Michiel

Classifications

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06T2207/30048

  Heart; Cardiac · CPC title

• G06T19/00

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• G06T2219/004

  Annotating, labelling · CPC title