Live 3D angiogram using registration of a surgical tool curve to an X-ray image

Patent metadata

Field	Value
Publication number	US-9675304-B2
Application number	US-201214127673-A
Country	US
Kind code	B2
Filing date	Jun 7, 2012
Priority date	Jun 27, 2011
Publication date	Jun 13, 2017
Grant date	Jun 13, 2017

Abstract

A method, system, and program product are provided for providing a live 3D image of a body lumen. The 3D shape of a flexible surgical tool in the body lumen is determined using optical shape sensing. An x-ray image is taken of the body lumen, with at least one of the body lumen and the surgical tool being radiopaque. The determined 3D surgical tool shape is registered to the x-ray image.

First claim

What is claimed is:

1. A method for providing a live 3D image of a body lumen, comprising the steps of:
determining the 3D shape of a flexible surgical tool in the body lumen using optical shape sensing;
taking an x-ray image of the body lumen, at least one of said body lumen and said surgical tool being radiopaque;
segmenting a 2D projection of the tool in the x-ray image; and
calculating a pose recovery matrix using the determined 3D shape and the segmented 2D projection.

2. The method of claim 1 , further comprising:
calculating the 3D tool shape in x-ray space; and
super-posing features from the x-ray image onto the determined 3D shape.

3. The method of claim 2 , further comprising:
displaying the 3D tool shape with x-ray features super-posed thereon.

4. The method of claim 3 , wherein the tool is a contrast catheter, and the step of taking an x-ray image comprises delivering contrast dye through the catheter to make the catheter radiopaque.

5. The method of claim 4 , wherein the body lumen is at least one blood vessel.

6. The method of claim 4 , wherein the step of taking an x-ray image is repeated, the 3D tool shape is determined in real time, and the 3D tool shape with x-ray features super-posed thereon is displayed in real time.

7. A system for providing a live 3D image of a body lumen, comprising:
a surgical tool having attached thereto, at least one optic fiber with shape sensing sensors formed therein;
at least one processor;
an optics module operably connected to the at least one processor, and comprising a light source;
an x-ray system operably connected to the at least one processor;
at least one memory operably connected to the at least one processor; and
at least one program of instruction encoded on the at least one memory, the at least one program of instruction executable by the at least one processor to:
interrogate the shape sensors using the light source in the optics module and determine the 3D shape of a flexible surgical tool in the body lumen using optical shape sensing;
take an x-ray image of the body lumen, at least one of said body lumen and said surgical tool being radiopaque; and
segment a 2D projection of the tool in the x-ray image; and
calculate a pose recovery matrix using the determined 3D shape and the segmented 2D projection.

8. The system of claim 7 , further comprising a display, wherein the at least one program of instruction further comprises, program instructions encoded on the at least one memory to display the 3D tool shape on the display.

9. The system of claim 7 , wherein the program instructions further comprise program instructions encoded on the at least one memory to:
calculate the 3D tool shape in x-ray space; and
super-pose features from the x-ray image onto the determined 3D shape.

10. The system of claim 9 , wherein the tool is a contrast catheter, to deliver contrast dye through the catheter prior to taking an x-ray image to make the catheter radiopaque.

11. A computer program product comprising a tangible, computer-readable storage device having a program of instructions encoded thereon, comprising:
program instructions for determining the 3D shape of a flexible surgical tool in the body lumen using optical shape sensing;
program instructions for taking an x-ray image of the body lumen, at least one of said body lumen and said surgical tool being radiopaque;
program instructions for segmenting a 2D projection of the tool in the x-ray image; and
program instructions for calculating a pose recovery matrix using the determined 3D shape and the segmented 2D projection.

12. The computer program product of claim 11 , further comprising:
program instructions encoded on the tangible, computer-readable storage device for calculating the 3D tool shape in x-ray space; and
program instructions encoded on the tangible, computer-readable storage device for super-posing features from the x-ray image onto the determined 3D shape;
and
registering the determined 3D surgical tool shape to the x-ray image.

13. The computer program product of claim 12 , further comprising:
program instructions encoded on the tangible, computer-readable storage device for displaying the 3D tool shape with x-ray features super-posed thereon.

14. The computer program product of claim 13 , wherein the tool is a contrast catheter, and prior to taking an x-ray image, a contrast dye is delivered through the catheter to make the catheter radiopaque.

15. The computer program product of claim 13 , wherein the program instructions for taking an x-ray image are repeated, and further comprising:
program instructions encoded on the tangible, computer-readable storage device for determining the 3D tool shape in real time; and
program instructions encoded on the tangible, computer-readable storage device for displaying the 3D tool shape with x-ray features super-posed thereon in real time.

Assignees

• Jain Ameet Kumar
• Koninklijke Philips Nv

Inventors

• Jain Ameet Kumar

Classifications

• A61B6/466

  adapted to display 3D data · CPC title

• A61B2090/376

  using X-rays, e.g. fluoroscopy · CPC title

• A61B6/507

  for determination of haemodynamic parameters, e.g. perfusion CT · CPC title

• A61B2090/364

  Correlation of different images or relation of image positions in respect to the body · CPC title

• A61B6/481

  involving the use of contrast agents · CPC title