2D/3D image registration

Patent metadata

Field	Value
Publication number	US-9262830-B2
Application number	US-201214002375-A
Country	US
Kind code	B2
Filing date	Feb 27, 2012
Priority date	Mar 4, 2011
Publication date	Feb 16, 2016
Grant date	Feb 16, 2016

Abstract

2D images are registered with 3D volume data. In order to provide 2D/3D registration with a facilitated workflow 3D volume data ( 112 ) of an object, having a frame of reference is received. A transformation plane ( 116 ) is defined in relation to the 3D volume data. A 2D image of the object with an image plane is received. The transformation plane is projected on the image plane. The frame of reference is aligned with the 2D image. At least one alignment interaction value ( 128 ) is projected ( 130 ) on the transformation plane to determine ( 134 ) at least one transformed interaction value ( 132 ). The frame of reference is translated with the at least one transformed interaction value.

First claim

The invention claimed is:

1. A method for registering 2D images with 3D volume data, comprising, with a processor:
receiving 3D volume data of an object, comprising a frame of reference;
receiving a first 2D image of the object with a first image plane in a first viewing direction;
blending the 2D image with a visualization of a projection of the 3D volume data in the first viewing direction;
spatially translating the 3D volume data in the first image plane to align the frame of reference with the first 2D image;
defining a first and a second transformation direction in relation to the 3D volume data and defining a transformation plane perpendicular to the first image plane;
providing a second 2D image of the object with a second image plane in a second viewing direction;
projecting the transformation plane on the second 2D image;
spatially translating the 3D volume data within the second image plane to align the frame of reference with the second 2D image;
projecting at least one alignment interaction value on the transformation plane to determine at least one transformed interaction value;
translating the frame of reference within the transformation plane with the at least one transformed interaction value;
projecting the 3D volume data in the second viewing direction; and
combining the second 2D image with the projected 3D image data.

2. The method according to claim 1 , wherein the following steps are provided:
providing a further 2D image of the object with a further image plane in a further viewing direction; and
projecting the transformation plane on the further 2D image;
aligning the frame of reference with the further 2D image;
wherein at least one further alignment interaction value is projected on the transformation plane to determine at least one further transformed interaction value; and
translating the frame of reference with the at least one further transformed interaction value.

3. The method according to claim 1 , wherein the 2D images are provided as current images: and wherein the 3D volume data is provided as a pre-operative 3D volume data;
wherein the 3D volume data is provided as CT volume data; and wherein the first and second 2D images are provided as X-ray fluoroscopy images.

4. The method according to claim 1 , further including:
with a display device, displaying the combined 2D images and the projections of the 3D volume data.

5. The method according to claim 1 , further including:
with one or more diagnostic imaging systems, generating the 3D volume data and a plurality of 2D images.

6. An imaging device for registering 2D images with 3D volume data, comprising:
one or more processors configured to:
receive 3D volume data of an object, comprising a frame of reference,
receive a first 2D image of the object with a first image plane in a first viewing direction,
blend the 2D image with a visualization of a projection of the 3D volume data in the first viewing direction,
spatially translate the 3D volume data in the first image plane to align the frame of reference with the first 2D image,
define a first and a second transformation direction in relation to the 3D volume data and defining a transformation plane perpendicular to the first image plane,
provide a second 2D image of the object with a second image plane in a second viewing direction,
project the transformation plane on the second 2D image,
spatially translate the 3D volume data within the second image plane to align the frame of reference with the second 2D image,
project at least one alignment interaction value on the transformation plane to determine at least one transformed interaction value,
translate the frame of reference within the transformation plane with the at least one transformed interaction value,
project the 3D volume data in the second viewing direction,
combine the second 2D image with the projected 3D image data; and
a display device configured to display the combined 2D images and the projections of the 3D volume data.

7. The imaging device according to claim 6 , further including:
an interface configured to provide the one or more processors with a user input.

8. The imaging device for registering 2D and 3D image data according to claim 6 further including:
one or more diagnostic scanners configured to acquire the data for the first 2D image and the second 2D image.

9. A non-transitory computer-readable medium carrying software for controlling one or more processors to perform the method according to claim 1 .

10. An imaging device for registering at least first and second 2D images which have at least one axis of their coordinate systems parallel to each other with 3D volume data, comprising:
one or more processors configured to:
define a transform plane perpendicular to an image plane of the first 2D image,
receive a translation vector which brings the second 2D image into registration with the 3D volume data,
project the translation vector onto the transformation plane to obtain a transformed translation vector,
translate the frame of reference of the 3D volume data using the transformed translation vector,
combine the second 2D image with the translated 3D volume data, and

a display device configured to display the combined 2D image and the translated 3D volume data.

Assignees

• Bakker Nicolaas Hylke
• Denissen Sandar Hans
• Van Den Boomen Wilhelmus Henrica Gerarda Maria
• Ruijters Daniel Simon Anna
• Mielekamp Pieter Maria
• Koninkl Philips Nv

Inventors

• Bakker Nicolaas Hylke
• Denissen Sandar Hans
• Van Den Boomen Wilhelmus Henrica Gerarda Maria
• Ruijters Daniel Simon Anna
• Mielekamp Pieter Maria

Classifications

• G06T2207/20212

  Image combination · CPC title

• G06T2211/404

  Angiography · CPC title

• G06T2207/30101

  Blood vessel; Artery; Vein; Vascular · CPC title

• G06T2207/20092

  Interactive image processing based on input by user · CPC title

• G06T7/0024 Primary

  Physics · mapped topic