Systems and methods for validating and correcting automated medical image annotations

Patent metadata

Field	Value
Publication number	US-9304982-B2
Application number	US-201414495789-A
Country	US
Kind code	B2
Filing date	Sep 24, 2014
Priority date	Sep 25, 2013
Publication date	Apr 5, 2016
Grant date	Apr 5, 2016

Abstract

Systems and methods are disclosed for manipulating image annotations. One method includes receiving an image of an individual's anatomy; automatically determining, using a processor, one or more annotations for anatomical features identified in the image of the individual's anatomy; determining a dependency or hierarchy between at least two of the one or more annotations for anatomical features identified in the image of the individual's anatomy; and generating, based on the dependency or hierarchy, a workflow prompting a user to manipulate the one or more annotations for anatomical features identified in the image of the individual's anatomy.

First claim

What is claimed is:

1. A computer-implemented method of manipulating image annotations, the method comprising:
receiving an image of an individual's anatomy;
automatically determining, using a processor, two or more annotations for anatomical features identified in the image of the individual's anatomy;
determining a dependency between at least two of the two or more annotations for anatomical features identified in the image of the individual's anatomy, wherein the dependency is defined such that a change in a first annotation results in a corresponding change in a second annotation;
receiving a modification to the first annotation;
determining an update to a second annotation dependent from the first annotation, in response to the modification to the first annotation;
determining a plurality of user interfaces displaying the modified first annotation or displaying the updated second annotation dependent on the first annotation; and
outputting the plurality of user interfaces displaying the modified first annotation or displaying the updated second annotation dependent from the first annotation in an order based on the dependency between at least two of the two or more annotations.

2. The method of claim 1 , further comprising includes presenting the plurality of user interfaces in an order of greatest number of dependencies to the least number of dependencies.

3. The method of claim 2 , further comprising:
prompting a validation request prior to presenting a next annotation in the plurality of user interfaces.

4. The method of claim 1 , further comprising:
prompting a validation request for a subset of the two or more annotations for anatomical features identified in the image of the individual's anatomy.

5. The method of claim 4 , further comprising:
presenting the subset of the two or more annotations for anatomical features identified in the image of the individual's anatomy multiple times or to multiple users.

6. The method of claim 1 , further comprising:
creating one or more visualizations for each of the two or more annotations for anatomical features identified in the image of the individual's anatomy.

7. The method of claim 6 , further comprising:
receiving one or more modifications to the two or more annotations for anatomical features identified in the image of the individual's anatomy based on tools associated with the one or more visualizations.

8. The method of claim 1 , wherein the update to the second annotation dependent from the first annotation includes
a re-computation of the second annotation.

9. A system for manipulating image annotations, the system comprising:
a data storage device storing instructions for identifying image acquisition parameters; and
a processor configured to execute the instructions to perform a method including:
receiving an image of an individual's anatomy;
automatically determining, using a processor, two or more annotations for anatomical features identified in the image of the individual's anatomy;
determining a dependency between at least two of the two or more annotations for anatomical features identified in the image of the individual's anatomy, wherein the dependency is defined such that a change in a first annotation results in a corresponding change in a second annotation;
receiving a modification to the first annotation;
determining an update to a second annotation dependent from the first annotation, in response to the modification to the first annotation;
determining a plurality of user interfaces displaying the modified first annotation or displaying the updated second annotation dependent on the first annotation; and
outputting the plurality of user interfaces displaying the modified first annotation or displaying the updated second annotation dependent from the first annotation in an order based on the dependency between at least two of the two or more annotations.

10. The system of claim 9 , wherein the system is further configured for presenting the plurality of user interfaces in an order of greatest number of dependencies to the least number of dependencies.

11. The system of claim 10 , wherein the system is further configured for:
prompting a validation request prior to presenting a next annotation in the plurality of user interfaces.

12. The system of claim 9 , wherein the system is further configured for:
prompting a validation request for a subset of the two or more annotations for anatomical features identified in the image of the individual's anatomy.

13. The system of claim 12 , wherein the system is further configured for:
presenting the subset of the two or more annotations for anatomical features identified in the image of the individual's anatomy multiple times or to multiple users.

14. The system of claim 9 , wherein the system is further configured for:
creating one or more visualizations for each of the two or more annotations for anatomical features identified in the image of the individual's anatomy.

15. The system of claim 14 , wherein the system is further configured for:
receiving one or more modifications to the two or more annotations for anatomical features identified in the image of the individual's anatomy based on tools associated with the one or more visualizations.

16. The system of claim 15 , wherein the update to the second annotation includes
a re-computation of the second annotation.

17. A non-transitory computer readable medium for use on a computer system containing computer-executable programming instructions for performing a method of manipulating image annotations, the method comprising:
receiving an image of an individual's anatomy;
automatically determining, using a processor, two or more annotations for anatomical features identified in the image of the individual's anatomy;
determining a dependency between at least two of the one or more annotations for anatomical features identified in the image of the individual's anatomy, wherein the dependency is defined such that a change in a first annotation results in a corresponding change in a second annotation;
receiving a modification to the first annotation;
determining an update to a second annotation dependent from the first annotation, in response to the modification to the first annotation;
determining a plurality of user interfaces displaying the modified first annotation or displaying the updated second annotation dependent on the first annotation; and
outputting the plurality of user interfaces displaying the modified first annotation or displaying the updated second annotation dependent from the first annotation in an order based on the dependency between at least two of the two or more annotations.

18. The non-transitory computer readable medium of claim 17 , wherein the method further comprises presenting the plurality of user interfaces in an order of greatest number of dependencies to the least number of dependencies.

19. The non-transitory computer readable medium of claim 18 , the method further comprising:
prompting a validation request prior to presenting a next annotation in the plurality of user interfaces.

20. The non-transitory computer readable medium of claim 17 , the method further comprising:
prompting a validation request for a subset of the two or more annotations for anatomical features identified in the image of the individual's anatomy.

Assignees

• Heartflow Inc

Inventors

• Grady Leo J
• Moreau-Gobard Romain
• Schaap Michiel

Classifications

• G06T2207/30196

  Human being; Person · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T19/003

  Navigation within 3D models or images · CPC title

• G06T7/0012

  Biomedical image inspection · CPC title