CBCT to MR registration via occluded shape reconstruction and robust point matching

Patent metadata

Field	Value
Publication number	US-11288846-B2
Application number	US-201716333612-A
Country	US
Kind code	B2
Filing date	Sep 28, 2017
Priority date	Sep 29, 2016
Publication date	Mar 29, 2022
Grant date	Mar 29, 2022

Abstract

In an image guidance method, a stream of cone-beam computed tomography (CBCT) images of an anatomical organ is acquired using a CBCT imaging device (34). For each CBCT image (44), the surface of the organ in the CBCT image is segmented to generate a segmented surface (70) of the anatomical organ in the CBCT image. Occluded shape reconstruction (66) using a statistical shape prior (68) may be used to reconstruct a missing or occluded surface portion. A pre-operative medical image (12) of the anatomical organ and the CBCT image are spatially registered by warping one of the images to the other of the images using point set registration of a segmented surface (30) of the organ in the preoperative medical image and the segmented surface of the organ in the CBCT image. A fused image (82) is displayed that combines the warped image and the other image.

First claim

The invention claimed is:

1. An image guidance device comprising:
a cone beam computed tomography (CBCT) imaging device;
an electronic processor;
a display; and
at least one non-transitory storage medium storing instructions readable and executable by the electronic processor to spatially register a liver imaged in a pre-operative medical image and the liver imaged in a CBCT image acquired by the CBCT imaging device by performing a spatial registration process including:
segmenting an outer surface of the liver in the pre-operative medical image to generate a first point set representing the segmented surface of the liver in the pre-operative medical image;
segmenting a surface of the liver in the CBCT image to generate a second point set representing the segmented surface of the liver in the CBCT image;
spatially registering the pre-operative medical image and the CBCT image by warping one of the pre-operative medical image and the CBCT image to the other of the pre-operative medical image and the CBCT image using point set registration comprising point matching of the first point set representing the segmented surface of the liver in the pre-operative medical image and the second point set representing the segmented surface of the liver in the CBCT image; and
displaying, on the display, a fused image combining the warped one of the pre-operative medical image and the CBCT image and the other of the pre-operative medical image and the CBCT image.

2. The image guidance device of claim 1 wherein the segmenting of the surface of the liver in the CBCT image includes:
performing occluded shape reconstruction using a statistical liver shape prior to reconstruct a missing portion of the segmented surface of the liver in the CBCT image.

3. The image guidance device of claim 1 wherein the segmenting of the surface of the liver in the CBCT image includes:
providing a user interface via which liver surface landmarks are received indicating the surface of the liver in the CBCT image; and
generating the segmented surface of the liver in the CBCT image based at least in part on the liver surface landmarks.

4. The image guidance device of claim 1 wherein:
the CBCT imaging device comprises a C-arm operated to stream CBCT images at an update rate, and
the instructions are readable and executable by the electronic processor to repeat the spatial registration process for other CBCT images of the stream to display, on the display, fused images updated at the update rate.

5. The image guidance device of claim 1 wherein the pre-operative medical image is a magnetic resonance imaging (MRI) image or a multiple-detector computed tomography (MDCT) image.

6. The image guidance device of claim 1 wherein the spatial registration process further includes:
segmenting the surface of the liver in the pre-operative medical image to generate the segmented surface of the liver in the pre-operative medical image.

7. The image guidance device of claim 1 wherein the spatial registering comprises:
warping the CBCT image to the pre-operative medical image using point set registration of the segmented surface ( 30 ) of the liver in the pre-operative medical image and the segmented surface of the liver in the CBCT image.

8. The image guidance device of claim 1 wherein displaying the fused image comprises:
displaying an overlay of the warped one of the pre-operative medical image and the CBCT image onto the other of the pre-operative medical image and the CBCT image wherein the overlay has partial transparency controlled by a transparency factor (a).

9. The image guidance device of claim 1 , wherein displaying the fused image comprises generating the fused image using a partially transparent overlay.

10. A non-transitory storage medium storing instructions readable and executable by an electronic processor to spatially register an anatomical organ imaged in a pre-operative medical image and the anatomical organ imaged in a cone beam computed tomography (CBCT) image by performing a spatial registration process including:
generating a segmented surface of the anatomical organ in the CBCT image by segmenting the surface of the anatomical organ in the CBCT image and performing occluded shape reconstruction using a statistical shape prior for the anatomical organ to reconstruct a portion of the segmented surface of the anatomical organ in the CBCT image; and
spatially registering the pre-operative medical image and the CBCT image by warping one of the pre-operative medical image and the CBCT image to the other of the pre-operative medical image and the CBCT image using point set registration comprising a non-planar grid of equally spaced points spread over segmented organ surfaces in the pre-operative medical image and the segmented surface of the anatomical organ in the CBCT image.

11. The non-transitory storage medium of claim 10 wherein the anatomical organ is a liver and the statistical shape prior is a statistical shape prior for the liver.

12. The non-transitory storage medium of claim 11 wherein the segmenting of the surface of the liver in the CBCT image includes:
providing a user interface via which liver surface landmarks are received indicating the surface of the liver in the CBCT image; and
generating the segmented surface of the liver in the CBCT image based at least in part on the liver surface landmarks.

13. The non-transitory storage medium of claim 10 wherein the spatial registration process further includes:
segmenting the surface of the anatomical organ in the pre-operative medical image to generate the segmented surface of the anatomical organ in the pre-operative medical image.

14. The non-transitory storage medium of claim 10 wherein the spatial registering comprises:
warping the CBCT image to the pre-operative medical image using point set registration of the segmented surface of the anatomical organ in the pre-operative medical image and the segmented surface of the anatomical organ in the CBCT image.

15. The non-transitory storage medium of claim 10 wherein the spatial registration process further includes:
displaying, on a display operatively connected with the electronic processor, a fused image combining the warped one of the pre-operative medical image and the CBCT image and the other of the pre-operative medical image and the CBCT image.

16. The non-transitory storage medium of claim 15 wherein the instructions are readable and executable by the electronic processor to repeat the spatial registration process for other CBCT images of a stream of CBCT images to display the fused images updated at an update rate of the stream.

17. An image guidance method comprising:
acquiring a stream of cone beam computed tomography (CBCT) images of an anatomical organ using a CBCT imaging device; and
for the CBCT images of the stream, performing a spatial registration process using an electronic processor, the spatial registration process for a CBT image including:
segmenting an outer surface of the anatomical organ in the CBCT image to generate a segmented surface of the anatomical organ in the CBCT image;
spatially registering a pre-operative medical image of the anatomical organ and the CBCT image by warping one of the pre-operative medical image and the CBCT image to the other of the pre-operative medical image and the CBCT image using point set registration of a segmented surface of the anatomical organ in the pre-operative medical image and the segmented surface of the anatomical organ in the CBCT image; and
providing for display a fused image combining the

Assignees

• Koninklijke Philips Nv
• Univ Yale

Inventors

• Treilhard John
• Lin Ming De
• Geschwind Jean-François
• Duncan James
• Smolka Susanne

Classifications

• G06T12/00 Primary

  Tomographic reconstruction from projections · CPC title

• G06T7/0014 Primary

  using an image reference approach · CPC title

• G06T2207/30056

  Liver; Hepatic · CPC title

• G06T7/0016

  involving temporal comparison · CPC title

• G06T2207/30096

  Tumor; Lesion · CPC title