Methods and devices for intraoperative viewing of patient 3D surface images

Patent metadata

Field	Value
Publication number	US-12333660-B2
Application number	US-202318210435-A
Country	US
Kind code	B2
Filing date	Jun 15, 2023
Priority date	Sep 28, 2015
Publication date	Jun 17, 2025
Grant date	Jun 17, 2025

Abstract

Methods and devices are disclosed for intra-operative viewing of pre- and intra-operative 3D patient images.

First claim

What is claimed is:

1. A method, comprising:
providing instructions for displaying, via a wearable device, a dataset on a patient,
wherein:
the dataset is based at least in part on a three-dimensional (3D) surface image of the patient or is based at least in part on a 3D model of the patient's surface anatomy,
the dataset is representative of an actual contour curve and a desired contour curve of the patient's surface anatomy, and
the actual and desired contour curves of the dataset (a) are aligned with each other and (b) are alignable with the patient such that the actual and desired contour curves of the dataset are aligned with landmarks on the patient's surface anatomy.

2. The method of claim 1 , wherein the wearable device includes a head-mounted display.

3. The method of claim 1 , further comprising displaying, via the wearable device, the dataset on the patient.

4. The method of claim 3 , wherein displaying the dataset on the patient includes projecting, via the wearable device, the dataset on the patient.

5. The method of claim 1 , wherein the dataset includes predetermined discrete interval values that represent (i) the actual contour curve of the patient's surface anatomy and (ii) intended changes to the actual contour curve of the patient's surface anatomy to achieve the desired contour curve.

6. The method of claim 5 , wherein the predetermined discrete interval values are based at least in part on (i) a type of intervention, (ii) a region of the patient's surface anatomy corresponding to the actual contour curve or to the desired contour curve, or (iii) a combination thereof.

7. The method of claim 1 , wherein the 3D surface image of the patient is a preoperative 3D surface image of the patient, or the 3D model of the patient's surface anatomy is a preoperative 3D model of the patient's surface anatomy.

8. The method of claim 1 , wherein the 3D surface image of the patient is a first intraoperative image of the patient, or the 3D model of the patient's surface anatomy is based at least in part on a second intraoperative image of the patient.

9. The method of claim 1 , wherein providing the instructions for displaying the dataset on the patient includes providing the instructions such that the dataset is intraoperatively alignable with the patient.

10. The method of claim 1 , wherein providing the instructions for displaying the dataset on the patient includes providing instructions for displaying, via the wearable device, the dataset on the patient such that the dataset is oriented to correspond to a viewer's vantage of the patient.

11. The method of claim 1 , wherein providing the instructions for displaying the dataset on the patient includes adjusting an orientation of the dataset such that the orientation of the dataset, when displayed on the patient via the wearable device, corresponds to a viewer's vantage of the patient.

12. The method of claim 11 , wherein adjusting the orientation of the dataset includes rotating, tilting, or translating the dataset such that, when the dataset is displayed on the patient via the wearable device, the actual and desired contour curves of the dataset are aligned with the landmarks on the patient's surface anatomy.

13. The method of claim 11 , wherein adjusting the orientation of the dataset includes continuously adjusting the orientation of the dataset according to the viewer's vantage of the patient as the viewer moves about the patient.

14. The method of claim 11 , wherein adjusting the orientation of the dataset includes adjusting the orientation of the dataset to a predetermined point of view corresponding to a range of locations that includes a current location of the viewer relative to the patient.

15. A system, comprising:
a dataset generated based at least in part on a three-dimensional (3D) surface image of a patient or based at least in part on a 3D model of the patient's surface anatomy, wherein the dataset is representative of an actual contour curve and a desired contour curve of the patient's surface anatomy, and wherein the actual and desired contour curves of the dataset (a) are aligned with each other and (b) are alignable with the patient such that the actual and desired contour curves of the dataset are aligned with landmarks on the patient's surface anatomy; and
a controller configured to provide instructions for displaying, via a wearable device, the dataset on the patient.

16. The system of claim 15 , further comprising the wearable device, and wherein the wearable device includes a head-mounted display.

17. The system of claim 15 , wherein the instructions for displaying the dataset on the patient include instructions for displaying, via the wearable device, the dataset on the patient such that the dataset is oriented to correspond to a viewer's vantage of the patient.

18. The system of claim 15 , wherein:
the controller is configured to adjust an orientation of the dataset such that the orientation of the dataset, when displayed on the patient via the wearable device, corresponds to a viewer's vantage of the patient; and
to adjust the orientation of the dataset, the controller is configured to tilt, rotate, or translate the dataset such that, when the dataset is displayed on the patient via the wearable device, the actual and desired contour curves of the dataset are aligned with the landmarks on the patient's surface anatomy.

19. The system of claim 18 , wherein, to adjust the orientation of the dataset, the controller is configured to continuously adjust the orientation of the dataset according to the viewer's vantage of the patient as the viewer moves about the patient.

20. The system of claim 18 , wherein, to adjust the orientation of the dataset, the controller is configured to adjust the orientation of the dataset to a predetermined point of view corresponding to a range of locations that includes a current location of the viewer relative to the patient.

Assignees

• Montefiore Med Center
• Albert Einstein College Medicine
• The New York City Health And Hospitals Corp
• The New York City Health And Hospitais Corp

Inventors

• Tepper Oren Mordechai
• Schreiber Jillian
• Colasante Cesar

Classifications

• G06T2210/41

  Medical · CPC title

• G06T2207/10048

  Infrared image · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T2207/10012

  Stereo images · CPC title

• G06T2200/04

  involving 3D image data · CPC title