Systems, methods and devices to scan 3D surfaces for intra-operative localization

Patent metadata

Field	Value
Publication number	US-11432878-B2
Application number	US-201716097410-A
Country	US
Kind code	B2
Filing date	Apr 28, 2017
Priority date	Apr 28, 2016
Publication date	Sep 6, 2022
Grant date	Sep 6, 2022

Abstract

Systems and methods are described herein to generate a 3D surface scan of a surface profile of a patient's anatomy. The 3D surface scan may be generated by reflections of structured light off the surface profile of the anatomy. The 3D surface scan may be used during intra-operative surgical navigation by a localization system. Optionally, a pre-operative medical image may also be registered to the localization system or used to enhance the 3D surface scan.

First claim

What is claimed is:

1. A computer implemented method to register a 3D surface scan of a surface profile of a patient's anatomy to a localization system comprising the steps of:
receiving, by at least one processing unit, scanning extrinsic parameter data with respect to a scanning reference element in a fixed position relative to the patient's anatomy, the scanning extrinsic parameter data being tracking data that can be used to calculate a scanning position and orientation;
receiving, by the at least one processing unit, from a camera, 3D scan data comprising images from a plurality of vantage points of structured light reflected off a surface of the patient's anatomy;
generating, by the at least one processing unit, scanning extrinsic parameters representing the scanning position and orientation of the camera with respect to the scanning reference element using the scanning extrinsic parameter data;
generating, by the at least one processing unit, a 3D surface scan of the surface profile of the anatomy with respect to the scanning reference element using the scanning extrinsic parameters and 3D scan data;
receiving, by the at least one processing unit, registration extrinsic parameter data with respect to a localization reference element of a localization system, the registration extrinsic parameter data being tracking data that can be used to calculate a registration position and orientation;
generating, by the at least one processing unit, registration extrinsic parameters representing the registration position and orientation of the localization reference element with respect to the scanning reference element from the registration extrinsic parameter data; and
registering, by the at least one processing unit, the 3D surface scan using the registration extrinsic parameters to the localization system to allow intra-operative navigation with respect to the 3D surface scan of the anatomy.

2. The method of claim 1 further comprising, following registering, providing intra-operative navigation of a surgical instrument with respect to the 3D surface scan of the anatomy wherein a navigation tracker is attached to the surgical instrument.

3. The method of claim 2 wherein the method comprises tracking a location of the surgical instrument using images of the navigation tracker and presenting, relative to the 3D surface scan, the location, location information derived therefrom or both the location and the location information.

4. The method of claim 1 wherein the structured light is projected by a structured light projector.

5. The method of claim 4 further comprises the step of determining a positional relationship between the camera and the structured light projector to co-register the camera to the structured light projector.

6. The method of claim 5 wherein the step of determining the positional relationship between the camera and the structured light projector comprises determining a position and orientation of calibration features using the camera, the features having a known positional relationship to the structured light projector.

7. The method of claim 1 wherein the scanning reference element and the localization reference element are a single reference element.

8. The method of claim 1 further comprising a step of receiving a medical image of the anatomy and using the medical image to compute and remove outliers in the 3D surface scan.

9. The method of claim 1 further comprising a step of receiving a medical image of the anatomy and registering the medical image of the anatomy to the 3D surface scan to determine an optimal mapping between the medical image and the 3D surface scan.

10. The method of claim 9 wherein the step of registering the medical image of the anatomy to the 3D surface scan comprises receiving input to identify anatomical landmarks on the anatomy in a localization system coordinate frame of the localization system; receiving input to identify locations on the medical image corresponding to the anatomical landmarks in an image coordinate frame of the medical image; and determining a transformation to map the anatomical landmarks to the identified locations in the respective coordinate frames.

11. The method of claim 1 further comprising the step of generating real time visual feedback to display on a display unit, the real time visual feedback comprising at least one of:
a camera feed comprising a field of view of the camera while the anatomy is being scanned;
graphics to visually emphasize at least one of the structured light as detected, the localization reference element and the scanning reference element;
a graphical representation of the 3D surface scan comprising a partially complete real time 3D surface scan; and
a visual representation of metrics representing registration data criteria for the anatomy.

12. The method of claim 11 wherein the registration data criteria is at least one of a correlation of aggregate 3D scan data with an expected surface profile of the anatomy, spatial and/or angular coverage of 3D scan data with respect to the anatomy, and density of 3D scan data with respect to anatomy.

13. The method of claim 1 wherein the step of receiving scanning extrinsic parameter data comprises receiving tracker data of a tracker and the step of generating scanning extrinsic parameters comprises generating a position and orientation of the camera with respect to the scanning reference element using the tracker data.

14. A computer implemented method to provide position and orientation measurements of a surgical instrument with respect to a 3D surface scan of an anatomy comprising the steps of:
receiving, by at least one processing unit, a 3D surface scan of the anatomy with respect to a scanning reference element;
receiving, by the at least one processing unit, registration extrinsic parameter data with respect to a localization reference element, the registration extrinsic parameter data being tracking data that can be used to calculate a registration position and orientation;
generating, by the at least one processing unit, registration extrinsic parameters representing the registration position and orientation of the localization reference element with respect to the scanning reference element from the registration extrinsic parameter data;
registering, by the at least one processing unit, the 3D surface scan to the localization reference element using the registration extrinsic parameters; and
providing, by the at least one processing unit, position and orientation measurements of the surgical instrument with respect the 3D surface scan of the anatomy.

15. The method of claim 14 wherein the step of generating registration extrinsic parameters from the registration extrinsic parameter data comprises generating a position and orientation measurement between the scanning reference element and the localization reference element.

16. The method of claim 14 wherein the localization reference element and the scanning reference element are a single reference element.

17. The method of claim 14 wherein the localization reference element is a tracker comprising optically detectable features and the localization system comprises at least one optical camera.

18. A computer storage device storing instructions in a non-transient manner which instructions when executed configure at least one processing unit to register a 3D surface scan of a surface profile of a patient's anatomy to a localization system comprising:
receiving, by the at least one processing unit, scanning extrinsic parameter data with respect to

Assignees

• Intellijoint Surgical Inc

Inventors

• Hladio Andre Novomir
• Fanson Richard Tyler
• Becker Luke
• Abadpour Arash
• Schipper Joseph

Classifications

• A61B90/14

  Fixators for body parts, e.g. skull clamps; Constructional details of fixators, e.g. pins · CPC title

• G06T2207/10081

  Computed x-ray tomography [CT] · CPC title

• A61B2090/373

  using light, e.g. by using optical scanners · CPC title

• A61B2034/2057

  Details of tracking cameras · CPC title

• A61B2090/3983

  Reference marker arrangements for use with image guided surgery · CPC title