Intermodal synchronization of surgical data

Patent metadata

Field	Value
Publication number	US-10959779-B2
Application number	US-201715597830-A
Country	US
Kind code	B2
Filing date	May 17, 2017
Priority date	Mar 15, 2013
Publication date	Mar 30, 2021
Grant date	Mar 30, 2021

Abstract

Systems and methods are provided in which local tissue diagnostic measurements are correlated with archival local tissue diagnostic data from prior tissue analyses to supplement diagnostic measurements with tissue analysis data from prior tissue analyses having similar local tissue diagnostic data. The tissue analysis data may include information such as pathology data, outcome data, and diagnosis data. The archived local tissue diagnostic data and the tissue analysis data may be stored in a database, and employed for a wide variety of methods, involving preoperative, intraoperative, and/or postoperative phases of a medical procedure. Methods and systems are also provided for displaying, on a medical image shown in a user interface, hyperlinked reference markers associated with tissue analyses, where the reference markers are shown at locations corresponding to local tissue analyses, and where associated diagnostic data and/or tissue analysis may be viewed by selecting a given reference marker.

First claim

What is claimed is:

1. A method of performing intraoperative biopsy tracking during at least one medical procedure, by way of an automatic system, the method comprising:
providing the automatic system comprising:
providing a control and processing system comprising providing a processor, a tracking system, and a tracking engine interfaced with the processor and the tracking system;
providing a storage device interfaced with the control and a processing system; and
providing an external user input and output device interfaced with the control and a processing system comprising providing a display device;

obtaining and automatically recording an initial medical image of at least a portion of a subject by using the tracking system;
registering the initial medical image to an intraoperative reference frame associated with the subject by the processor;
intraoperatively tracking and automatically recording at least one biopsy instrument by using the tracking system;
intraoperatively detecting and automatically recording at least one location associated with at least one biopsy intraoperatively performed on the subject by using the tracking system;
comparing, according to pre-selected similarity criteria, biopsy analysis data and archival biopsy analysis data associated with the at least one medical procedure by using the processor, comparing comprising:
detecting and identifying a plurality of local features in images relating to the biopsy analysis data and images relating to the archival biopsy data by using computer vision;
detecting and identifying a plurality of local features in the initial medical image by using a scale-invariant feature transform algorithm to facilitate searching the biopsy analysis data and the archival biopsy data, using the scale-invariant feature transform algorithm comprising: producing a difference image from the initial medical image by blurring the initial medical image, thereby producing a blurred image; subtracting the blurred image from the initial medical image, thereby producing the difference image; locating pixel amplitude extrema in the difference image; defining a corresponding pixel region about each pixel amplitude extremum of the pixel amplitude extrema; producing a plurality of component subregion descriptors for each subregion of a pixel region about the pixel amplitude extrema in the difference image; correlating the plurality of component subregion descriptors for each subregion of the pixel region about the pixel amplitude extrema in the difference image with a plurality of component subregion descriptors for each subregion of a pixel region about the pixel amplitude extrema in the initial medical image; and indicating detection of each local feature of the plurality of local features if a number of component subregion descriptors of the plurality of component subregion descriptors defines an aggregate correlation exceeding a threshold correlation;
reducing a size of the biopsy analysis data and the archival biopsy data by decomposing images relating to a clinical data set using at least one feature extraction algorithm, the clinical data set comprising data relating to at least one of: imaging contrast dynamics, diffusion information, quantitative T1 and T2, CT contrast flow, and PET tracer dynamics, whereby searching the biopsy analysis data and the archival biopsy data is performed in a dimensional space less than that corresponding to all of the biopsy analysis data and the archival biopsy data; and
correlating apparent diffusion coefficient (ADC) with cellularity to build a mathematical model by using additional clinically relevant criteria comprising at least one of: a tumor size, a tumor location, a tumor histology, and a pathology result, thereby transforming measured ADC values into cellularity measures;

displaying at least one hyperlinked reference marker associated with the at least one biopsy on the medical image by using the display device, displaying comprising displaying the at least one hyperlinked reference marker in relation to the at least one location corresponding to the at least one biopsy, and displaying comprising displaying the at least one hyperlinked reference marker as at least one of a label and text, whereby a given hyperlinked reference marker is selectable from the at least one hyperlinked reference marker, and whereby at least one of associated diagnostic data and biopsy analysis data is viewable;
obtaining and automatically recording the biopsy analysis data corresponding the at least one biopsy by using the processor;
receiving input, identifying a selected hyperlinked reference marker associated with a selected biopsy, by using the display device; and
presenting at least a portion of the biopsy analysis data associated with the selected hyperlinked reference marker, by using the display device.

2. The method according to claim 1 ,
wherein displaying further comprises displaying the at least one hyperlinked reference marker as at least one of an icon and a tag,
wherein comparing, according to the pre-selected similarity criteria, comprises evaluating at least metric associated with at least one local tissue analysis performed on the subject and at least one prior local tissue analysis, the at least one prior local tissue analysis associated with at least one of a medical history of the subject and a plurality of medical histories associated with a collection of other subjects,
wherein the biopsy analysis data is obtained intraoperatively,
wherein receiving the input comprises intraoperatively receiving the input, and
wherein presenting the biopsy analysis data comprises intraoperatively presenting the biopsy analysis data.

3. The method according to claim 1 further comprising:
intraoperatively acquiring local in-vivo diagnostic data from a local diagnostic measurement performed in a region associated with the at least one biopsy; and
in the event that local in-vivo diagnostic data is available for the biopsy associated with the selected reference marker, presenting at least a portion of the local intraoperative diagnostic data associated with the selected reference marker.

4. The method according to claim 3 , wherein a diagnostic modality, associated with the local diagnostic measurement, comprises an imaging modality.

5. The method according to claim 3 , wherein a diagnostic modality, associated with the local diagnostic measurement, comprises an optical modality.

6. The method according to claim 5 , wherein the optical modality, associated with the local diagnostic measurement, comprises an optical imaging modality.

7. The method according to claim 5 , wherein the optical modality, associated with the local diagnostic measurement, comprises Raman spectroscopy.

8. The method according to claim 5 , wherein the optical modality, associated with the local diagnostic measurement, comprises hyperspectral analysis.

9. The method according to claim 1 , further comprising providing a visual representation of an estimated error, associated with the accuracy of the at least one location corresponding to the at least one biopsy by using the display device.

10. The method according to claim 1 , wherein the biopsy analysis data is overlaid on the medical image.

11. The method according to claim 1 , wherein the biopsy analysis data is displayed in a separate window of a user interface.

12. The method according to claim 1 , wherein obtaining and automatically recording the medical image is preoperatively performed.

13. The method according to claim 1 , wherein obtaining and automatically recording the medical image and intraoperatively performing the at least one biopsy

Assignees

• Synaptive Medical Inc

Inventors

• Piron Cameron
• Sela Gal
• Thomas Monroe M
• Alexander Simon
• Yuwaraj Murugathas
• Wood Michael
• Panther Alex
• Richmond Joshua
• Hodges Wes
• Gallop David

Classifications

• G16H70/20

  relating to practices or guidelines · CPC title

• G16H50/50

  for simulation or modelling of medical disorders · CPC title

• G16H30/40

  for processing medical images, e.g. editing · CPC title

• A61B2576/026

  for the brain · CPC title

• A61B2034/2055

  Optical tracking systems · CPC title