Interacting with a three-dimensional object dataset

Patent metadata

Field	Value
Publication number	US-9773347-B2
Application number	US-201214356413-A
Country	US
Kind code	B2
Filing date	Oct 15, 2012
Priority date	Nov 8, 2011
Publication date	Sep 26, 2017
Grant date	Sep 26, 2017

Abstract

A system ( 20 ) for interacting with a three-dimensional object dataset comprises a signal input ( 21 ) for receiving a signal from an interaction device ( 34 ) comprising a touch sensitive surface ( 35 ) having a typical shape of at least part of an object represented by the three-dimensional object dataset, wherein the signal is indicative of a location on the touch sensitive surface ( 35 ) that is touched. The system further comprises a mapping unit ( 22 ) for mapping the touched location to a corresponding point of the object represented by the three-dimensional object dataset. The three-dimensional object dataset is based on a signal obtained from a scanner ( 24 ) arranged for scanning the object.

First claim

The invention claimed is:

1. A system for annotating a three-dimensional medical image of an anatomic object of a patient, the three-dimensional medical image being based on a signal obtained from a medical image scanner arranged for scanning the three-dimensional anatomic object of the patient, the system comprising:
a display device that displays at least a part of the three-dimensional medical image of the anatomic object of the patient;
a three-dimensional interaction device comprising a surface having a typical shape of at least part of a kind of anatomic object represented by the three-dimensional anatomic object of the patient, wherein the interaction device provides a signal that is indicative of a location on the surface that is indicated by a user; and
a processor that:
registers the three-dimensional medical image of the anatomic object of the patient to an electronic representation of the shape of the surface of the interaction device to obtain a registration:
receives the signal that is indicative of the location on the surface indicated by the user
maps the indicated location to a corresponding point of the medical image of the anatomic object of the patient based on the registration;

receives a user provided annotation; and
attaches the user provided annotation to a position within the three-dimensional medical image of the anatomic object of the patient corresponding to the location on the surface indicated by the user.

2. The system of claim 1 , wherein the surface comprises a touch sensitive surface, and the signal is indicative of a location on the touch sensitive surface that is touched.

3. The system of claim 1 , wherein the processor displays an indication of the position within the three-dimensional medical image corresponding to the location on the surface indicated by the user.

4. The system of claim 1 , wherein the processor is further configured to receive a command to be executed with respect of the position within the three-dimensional medical image corresponding to the location on the surface indicated by the user.

5. The system of claim 1 , further comprising an ontology comprising a plurality of terms describing different parts of the object, and wherein the processor maps the indicated position to a term describing a part of the anatomic object of the patient corresponding to the indicated position.

6. The system of claim 1 , wherein the surface comprises a display arranged for displaying information based on the three-dimensional medical image.

7. A workstation comprising a system of claim 1 .

8. The system of claim 1 , wherein the shape of the interaction device represents an average shape or a modeled shape of the anatomic object of the patient represented by the three-dimensional medical image.

9. A method of annotating a three-dimensional medical image of a patient, comprising
obtaining the three-dimensional medical image by obtaining a signal from a scanner arranged for scanning a particular anatomic object of the patient;
receiving a signal from an interaction device comprising a touch sensitive surface having a typical shape of at least part of a kind of object represented by the anatomic object of the three-dimensional medical image, wherein the signal is indicative of a location on the touch sensitive surface that is indicated by a user;
registering the anatomic object of the three-dimensional medical image to an electronic representation of the shape of the surface of the interaction device to obtain a registration; and
mapping the indicated location to a corresponding point of the anatomic object of the patient based on the registration;
receiving a user provided annotation; and
attaching the user provided annotation to a position within the three-dimensional medical image corresponding to the location on the surface indicated by the user.

10. A non-transitory computer readable medium comprising instructions for causing a processor system to perform the method of claim 9 .

11. The method of claim 9 , including receiving a command to be executed with respect of the position within the three-dimensional medical image corresponding to the location on the surface indicated by the user.

12. A non-transitory computer-readable medium comprising a program that, when executed by a processor, causes the processor to:
receive a three-dimensional medical image of an anatomic object of a patient that includes an image of the anatomic object of the patient;
display at least a part of the medical image on a display device;
receive an electronic representation of a three-dimensional interaction device, the interaction device having a surface corresponding to a typical shape of a kind of anatomic object representing the anatomic object of the patient;
register the electronic representation of the interaction device to the image of the anatomic object of the patient to create a registration;
receive a signal corresponding to a touch of the surface by a user, the signal indicating a location of the touch on the interaction device;
map the location of the touch to a corresponding location of the image of the anatomic object of the patient;
receive an annotation from the user; and
attach the annotation to the image of the anatomic object of the patient at the corresponding location of the image.

13. The medium of claim 12 , wherein the three-dimensional medical image is provided by a medical scan device.

14. The medium of claim 12 , wherein the program causes the processor to display the annotation on the display device.

15. The medium of claim 12 , wherein the surface of the interaction device comprises a touch-sensitive surface.

16. The medium of claim 12 , wherein the surface of the interaction device includes a display surface, and the program causes the processor to display at least a portion of the medical image on the display surface.

17. The medium of claim 12 , wherein the program causes the processor to display an indication of the location of the image corresponding to the location of the touch.

18. The medium of claim 12 , wherein the program causes the processor to receive a command from the user related to the location of the touch, and to execute the command based on the location of the touch.

19. The medium of claim 12 , wherein the program causes the processor to access an ontology comprising a plurality of terms describing parts of a body, and the annotation includes a term of the plurality of terms corresponding to a part of the anatomic object of the patient at the location of the touch.

20. The medium of claim 12 , wherein the program causes the processor to access a medical record of the patient and to display information from the medical record of the patient related to the anatomic object of the patient.

Assignees

• Koninklijke Philips Nv

Inventors

• Groth Alexandra
• Lehmann Helko
• Weese Juergen

Classifications

• G09B23/34

  with removable parts · CPC title

• G06F2203/0383

  Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN · CPC title

• G06F3/041

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G09B23/30

  Anatomical models {(G09B23/281 - G09B23/288 take precedence)} · CPC title

• G06T19/003 Primary

  Navigation within 3D models or images · CPC title