Real-time medical image visualization systems and related methods

Patent metadata

Field	Value
Publication number	US-10643360-B2
Application number	US-201815893404-A
Country	US
Kind code	B2
Filing date	Feb 9, 2018
Priority date	Feb 10, 2017
Publication date	May 5, 2020
Grant date	May 5, 2020

Abstract

Some systems include a memory, and a processor coupled to the memory, wherein the processor is configured to: identify one or more spatial markers in a medical data-based image of a patient, identify one or more spatial markers in a real-time perceived image of the patient, wherein the one or more spatial markers in the medical data-based image correspond to an anatomical feature of the patient and the one or more spatial markers in the real-time perceived image correspond to the anatomical feature of the patient, superimpose the medical data-based image of the patient with the real-time perceived image of the patient, and align the one or more spatial markers in the medical data-based image with the respective one or more spatial markers in the real-time perceived image.

First claim

The invention claimed is:

1. A system comprising:
a user interface device comprising:
one or more sensors;
a memory; and
a processor coupled to the memory;

wherein the processor is configured to:
identify one or more spatial markers in a medical data-based image of a patient;
in real-time:
receive a real-time perceived image of the patient from the one or more sensors;
based on a field of view of the one or more sensors, detect one or more spatial markers within the real-time perceived image, wherein the one or more spatial markers in the medical data-based image correspond to an anatomical feature of the patient and the one or more spatial markers in the real-time perceived image correspond to the anatomical feature of the patient;
superimpose the medical data-based image of the patient with the real-time perceived image of the patient;
align the one or more spatial markers in the superimposed medical data-based image with the respective one or more spatial markers in the real-time perceived image; and
initiate display, via the user interface device, of the medical data-based image of the patient with the real-time perceived image such that the one or more spatial markers in the medical data-based image are aligned and superimposed with the one or more spatial markers in the real-time perceived image.

2. The system of claim 1 , wherein the medical data-based image comprises at least one of the following: a computed axial tomography (CAT) image, a magnetic resonance imaging (MRI) image, a positron emission tomography (PET) image, an ultrasound image, and an x-ray image.

3. The system of claim 1 , wherein the anatomical feature of the patient comprises one or more of the following: one or both eye sockets, a mouth, one or both ears, and an anterior nasal aperture.

4. The system of claim 1 , wherein:
the user interface further comprises a display screen;
the processor is further configured to initiate display, the display screen, of the medical data-based image of the patient with the real-time perceived image such that the one or more spatial markers in the medical data-based image are aligned and superimposed with the one or more spatial markers in the real-time perceived image; and
the real-time perceived image of the patient is captured by the one or more sensors.

5. The system of claim 1 , wherein the one or more sensors are configured to detect movement of the position of the one or more spatial markers in the real-time perceived image; and wherein the processor is configured to update the position of the one or more spatial markers of the medical data-based image in response to the detected movement of the position of the one or more spatial markers in the real-time perceived image.

6. The system of claim 1 , wherein the user interface device comprises a smartphone.

7. The system of claim 1 , wherein the user interface device comprises wearable computer glasses.

8. The system of claim 1 , wherein the user interface device comprises a tablet computer.

9. A computerized method comprising:
identifying one or more spatial markers in a medical data-based image of a patient with a user interface device;
in real-time:
based on a field of view of the one or more sensors, detecting one or more spatial markers in a real-time perceived image of the patient with the user interface device, wherein the one or more spatial markers in the medical data-based image correspond to an anatomical feature of the patient and the one or more spatial markers in the real-time perceived image correspond to the anatomical feature of the patient;
simultaneously displaying the medical data-based image of the patient and the real-time perceived image of the patient via the user interface device;
aligning the one or more spatial markers in the medical data-based image with the one or more spatial markers in the real-time perceived image with the user interface device; and
initiating display, via the user interface device, of the medical data-based image of the patient with the real-time perceived image such that the one or more spatial markers in the medical data-based image are aligned and superimposed with the one or more spatial markers in the real-time perceived image.

10. The method of claim 9 , wherein the medical data-based image comprises at least one of the following: a computed axial tomography (CAT) image, a magnetic resonance imaging (MRI) image, a positron emission tomography (PET) image, an ultrasound image, and an x-ray image.

11. The method of claim 9 , wherein the anatomical feature of the patient comprises one or more of the following: one or both eye sockets, a mouth, one or both ears, and an anterior nasal aperture.

12. The method of claim 9 , wherein the real-time perceived image of the patient is captured by one or more sensors configured to capture an image.

13. The method of claim 9 , comprising:
detecting movement of the one or more spatial markers in the real-time perceived image; and
updating on a display a position of the one or more spatial markers of the medical data-based image in response to the detected movement of the one or more spatial markers in the real-time perceived image.

14. The computerized method of claim 9 , further comprising demonstrating in real-time the orientation, location, and/or spatial relevance of the anatomical feature of the patient relative to the perceived image with the user interface device.

15. The computerized method of claim 14 , wherein the real-time perceived image of the patient is captured by the one or more sensors, and wherein the one or more sensors are included in a camera.

16. The computerized method of claim 14 , wherein:
the one or more sensors are configured to detect movement of the position of the one or more spatial markers in the real-time perceived image; and
the processor is configured to update the position of the one or more spatial markers of the medical data-based image in response to the detected movement of the position of the one or more spatial markers in the real-time perceived image.

17. The system of claim 1 , further comprising a login controller, wherein the login controller is configured to determine whether the medical data-based image of the patient matches the real-time perceived image of the patient.

18. The system of claim 17 , wherein the login controller is configured to retrieve the medical data-based image of the patient based on a determination that the medical data-based image of the patient matches the real-time perceived image of the patient.

19. The system of claim 17 , wherein the login controller is configured to restrict access to the medical data-based image based on a determination that the medical data-based image of the patient does not match the real-time perceived image of the patient.

Assignees

• Univ Arizona State

Inventors

• Frakes David
• Maciejewski Ross
• Spano Mark
• Plaas Dustin
• Van Putten Alison
• Sansone Joseph
• Mortensen Matthew
• Kirkpatrick Nathaniel
• Thomas Jonah

Classifications

• A61B2090/372

  Details of monitor hardware · CPC title

• A61B2090/502

  Headgear, e.g. helmet, spectacles · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• A61B2090/365

  augmented reality, i.e. correlating a live optical image with another image · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title