Data display and processing algorithms for 3D imaging systems

Patent metadata

Field	Value
Publication number	US-9786056-B2
Application number	US-201414777092-A
Country	US
Kind code	B2
Filing date	Mar 17, 2014
Priority date	Mar 15, 2013
Publication date	Oct 10, 2017
Grant date	Oct 10, 2017

Abstract

The present disclosure provides methods to process and/or display data collected using 3D imaging probes. The methods include: a) methods for mapping a single 2D frame onto a 3D representation of a volume; b) methods for dynamically updating portions of a 3D representation of a volume with a high temporal resolution, while leaving the remainder of the volume for contextual reference; c) methods for registering volumetric datasets acquired with high temporal resolution with volumetric datasets acquired with relatively low temporal resolution in order to estimate relative displacement between the datasets; and d) methods for identifying structures within a volume and applying visual cues to the structures in subsequent volumes containing the structures.

First claim

Therefore what is claimed is:

1. A method for forming a composite visual display, from a plurality of volumetric image data sets, comprising the steps of:
a) receiving a first volumetric image data set of a first volume obtained over a first time interval using a mechanically scanned imaging device, and processing said first volumetric image data set to reconstruct a representation of the first volume;
b) defining a region of interest within the first volume;
c) receiving an additional image data set of the region of interest obtained over a second time interval shorter than the first time interval;
d) combining the additional image data set of the region of interest with the first volumetric image data set to produce a combined image data set, and processing the combined data set to reconstruct a combined representation of the first volume; and
e) repeating steps c) and d) one or more times; and
f) repeating steps a) and c) through e) one or more times, such that the representation of the region of interest portion of the first volume is updated more frequently than a remainder portion of the first volume that does not include the region of interest portion.

2. The method according to claim 1 , wherein the region of interest defined in step b) remains invariant as step e) is performed.

3. The method according to claim 1 , further comprising repeating step b) when performing step e), such that the region of interest initially defined in step b) may be variable based on an operator definable criteria.

4. The method according to claim 1 , wherein the region of interest defined in step b) may be variable based on a system definable criteria as steps b) through d) are repeated.

5. The method according to claim 1 , wherein the region of interest defined in step b) is a single 2D frame of imaging data.

6. The method according to any claim 1 further including testing a spatial alignment accuracy between representation of the region of interest and the representation of the first volume.

7. The method according to claim 6 wherein when the spatial alignment falls below an acceptable level of alignment, repeat steps a) to e) zero or more times.

8. The method according claim 1 where the imaging modality is ultrasound.

9. The method according to claim 1 where the imaging modality is optical coherence tomography.

10. The method according to claim 1 where the acquisition is characterized by a coordinate system defined using a radius r, angle ‘theta’ (Θ) and angle ‘phi’ (φ).

11. The method according to claim 1 where the acquisition is characterized by a coordinate system defined using a radius r, angle ‘theta’ (Θ) and position d.

12. The method according to claim 1 further comprising displaying the combined representation.

13. The method according to claim 12 , further including applying visual cues to the combined representation so that the representation of the region of interest is visually differentiated from the remainder portion of the first volume.

14. A method according to claim 13 , wherein said visual cue is a color hue applied to at least one of the representation of the region of interest and the remainder portion of the first volume.

15. A method according to claim 13 , wherein said visual cue is a transparency value applied to at least one of the representation of the region of interest and the remainder portion of the first volume.

16. The method according to claim 13 , wherein said visual cue is a time dependent cue applied to the representation of the remainder portion of the first volume to indicate the time that has elapsed since the first volumetric image data set was acquired.

17. A method for calculating changes to a position and/or orientation of an imaging device during acquisition of multiple images of a volume, comprising the steps of:
a) receiving a first set of imaging data from a first volume acquired over a first time interval with the imaging device;
b) processing said first set of imaging data from the first volume to reconstruct a representation of the first volume suitable for display;
c) receiving an additional set of imaging data from an additional volume acquired over an additional time interval shorter than said first time interval with the imaging device;
d) processing said additional set of imaging data to reconstruct a representation of the additional volume;
e) processing the representation of the first volume with the representation of the additional volume to register the representation of the first volume with the representation of the additional volume;
f) wherein in the event an acceptable registration is achieved, computing a position and/or orientation of the imaging device during acquisition of the additional set of imaging data relative to a position and/or orientation of the imaging device during acquisition of the first set of imaging data, and repeating steps c) through e) zero or more times; and
g) in the event registration is not achieved repeat steps a) through e) zero or more times.

18. The method according to claim 17 wherein a spatial resolution of the additional set of imaging data is lower than a spatial resolution of the first set of imaging data.

19. The method according to claim 17 wherein a field of view of the additional set of imaging data is smaller than a field of view of the first set of imaging data.

20. The method according to claim 17 wherein step e) includes:
computing estimated positions and/or orientations of the imaging device based on a current known location of the imaging device and its characteristic degrees of freedom; and
employing the estimated positions and/or orientations of the imaging device when performing registration.

21. The method according to claim 17 wherein step e) includes:
computing one or more expected trajectories of the imaging device; and
incorporating the one or more estimated trajectories of the imaging device when performing registration.

22. The method according to claim 17 wherein step f) further includes updating the reconstructed representation of the first volume to indicate the position and/or orientation of the imaging device during acquisition of the addition set of imaging data.

23. The method according to claim 17 wherein the image set of a first volume and the additional volume are obtained using ultrasound.

24. The method according to claim 17 wherein the image set of a first volume and the additional volume are obtained using optical coherence tomography.

25. The method according to claim 17 where the acquisition is characterized by a coordinate system defined using a radius r, angle ‘theta’ ( 0 ) and angle ‘phi’ (φ).

26. The method according to claim 17 wherein the acquisition is characterized by a coordinate system defined using a radius r, angle ‘theta’ (Θ) and position d.

27. A method for identifying and highlighting a region in a volume during multiple scans of the volume, comprising the steps of:
a) acquiring an image set of a first volume and producing a 3D representation of the first volume from the image set;
b) identifying a region of interest in the 3D representation of the first volume;
c) characterizing the region of interest with a set of parameters and storing the set of parameters of the characterized region;
d) applying a visualization cue to the characterized region of interest;
e) acquiring an additional image set of a

Assignees

• Colibri Tech Inc
• Sunnybrook Res Inst
• Conavi Medical Inc

Inventors

• Courtney Brian
• Witcomb Neil

Classifications

• G06T12/00

  Tomographic reconstruction from projections · CPC title

• G06T2207/10132

  Ultrasound image · CPC title

• G06T19/00

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• A61B8/483

  involving the acquisition of a 3D volume of data · CPC title

• G06T2207/30068

  Mammography; Breast · CPC title