Visualization of catheter of three-dimensional ultrasound

Patent metadata

Field	Value
Publication number	US-9993304-B2
Application number	US-201213997800-A
Country	US
Kind code	B2
Filing date	Jan 10, 2012
Priority date	Jan 13, 2011
Publication date	Jun 12, 2018
Grant date	Jun 12, 2018

Abstract

An image-guided system includes an X-ray imaging device for generating one or more X-ray images illustrating a tool within an anatomical region, and an ultrasound imaging device for generating an ultrasound image illustrating the tool within the anatomical region. The image-guided system further includes a tool tracking device for visually tracking the tool within the anatomical region. In operation, the tool tracking device localizes a portion of the tool as located within the ultrasound image responsive to an identification of the portion of the tool as located within the X-ray image(s), and executes an image segmentation of an entirety of the tool as located within the ultrasound image relative to a localization of the portion of the tool as located within the ultrasound image.

First claim

The invention claimed is:

1. An image-guided system, comprising:
an X-ray imaging device having an X-ray source and an X-ray detector, the X-ray imaging device being configured to generate at least one X-ray image illustrating a tool within an anatomical region;
an ultrasound imaging device configured to acquire a three-dimensional (3D) ultrasound (US) volume, the 3D US volume including an ultrasound image illustrating the tool within the anatomical region in the 3D US volume; and
a tool tracking device configured to:
perform a registration of the ultrasound image with the X-ray image,
localize a portion of the tool as located within the ultrasound image based on an identification of the portion of the tool as located within the at least one X-ray image by localizing the portion of the tool along at least one line extending from the X-ray source to a projection of the tool on the X-ray detector through the 3D US volume after the registration of the ultrasound image with the X-ray image,
perform an execution of an image segmentation of an entirety of the tool as located within the ultrasound image relative to a localization of the portion of the tool as located within the ultrasound image, and
track the portion of the tool as located within the ultrasound image from a first location in a previous 3D US volume acquired in a previous time to a second location in a next 3D US volume acquired in a next time which is after the previous time by estimating a state vector X using an ultrasound volume history to propagate samples from the previous 3D US volume to the next 3D US volume, wherein the state vector X includes location information and pose information of the tool, the location information being confined to single translation along the at least one line extending from the X-ray source to the projection of the tool on the X-ray detector through the 3D US volume.

2. The image-guided system of claim 1 , wherein the tool is a catheter, and wherein the portion of the tool is a tip of the tool.

3. The image-guided system of claim 1 , wherein the X-ray imaging device is one of a group including a monoplane X-ray imaging device and a bi-plane X-ray imaging device.

4. The image-guided system of claim 1 , wherein the execution of the image segmentation of the entirety of the tool as located within the ultrasound image relative to the localization of the portion of the tool as located within the ultrasound image includes:
constructing an initial weighted energy graph; and
executing a graph-cut segmentation of the initial weighted energy graph.

5. The image-guided system of claim 4 , wherein the execution of the image segmentation of the entirety of the tool as located within the ultrasound image relative to the localization of the portion of the tool as located within the ultrasound image further includes:
applying a shape filter to the graph-cut segmentation of the initial weighted energy graph;
constructing a final weighted energy graph as a function of the application of the shape filter to the graph-cut segmentation of the initial weighted energy graph; and
executing a graph-cut segmentation of the final weighted energy graph.

6. The image-guided system of claim 1 , wherein the at least one line serves as at least one boundary constraint for the execution of the image segmentation of the entirety of the tool as located within the ultrasound image and the localized portion of the tool is used as an initial seed point for the image segmentation within the ultrasound image.

7. A tool tracking device for tracking a tool within an anatomical region, the tool tracking device comprising:
a tool identification module configured to:
perform a registration of an ultrasound image included in a three-dimensional (3D) ultrasound (US) volume with an X-ray image illustrating the tool within the anatomical region
localize a portion of the tool as located within the ultrasound image illustrating the tool within the anatomical region based on an identification of the portion of the tool as located within the X-ray image illustrating the tool within the anatomical region by localizing the portion of the tool along at least one line extending from an X-ray source of an X-ray imaging device to a projection of the tool on an X-ray detector of the X-ray imaging device through the 3D US volume after the registration of the ultrasound image with the X-ray image, and
track the portion of the tool as located within the ultrasound image from a first location in a previous 3D US volume acquired in a previous time to a second location in a next 3D US volume acquired in a next time which is after the previous time by estimating a state vector X using an ultrasound volume history to propagate samples from the previous 3D US volume to the next 3D US volume, wherein the state vector X includes location information and pose information of the tool, the location information being confined to single translation along the at least one line extending from the X-ray source to the projection of the tool on the X-ray detector through the 3D US volume; and
an image segmentation module configured to perform an execution of an image segmentation of an entirety of the tool as located within the ultrasound image relative to a localization of the portion of the tool as located within the ultrasound image.

8. The tool tracking device of claim 7 , wherein the tool is a catheter, and wherein the portion of the tool is a tip of the tool.

9. The tool tracking device of claim 7 , wherein the execution of the image segmentation of the entirety of the tool as located within the ultrasound image relative to the localization of the portion of the tool as located within the ultrasound image further includes:
constructing an initial weighted energy graph; and
executing a graph-cut segmentation of the initial weighted energy graph.

10. The tool tracking device of claim 9 , wherein the execution of the image segmentation of the entirety of the tool as located within the ultrasound image relative to the localization of the portion of the tool as located within the ultrasound image further includes:
applying a shape filter to the graph-cut segmentation of the initial weighted energy graph;
constructing a final weighted energy graph as a function of the application of the shape filter to the graph-cut segmentation of the initial weighted energy graph; and
executing a graph-cut segmentation of the final weighted energy graph.

11. The tool tracking device of claim 7 , wherein the at least one line serves as at least one boundary constraint for the execution of the image segmentation of the entirety of the tool as located within the ultrasound image and the localized portion of the tool is used as an initial seed point for the image segmentation within the ultrasound image.

12. An image-guided method for tracking a tool within an anatomical region, comprising acts of:
generating by an X-ray imaging device an X-ray image illustrating the tool within an anatomical region, the X-ray imaging device having an X-ray source and an X-ray detector;
acquiring by an ultrasound imaging device a three-dimensional (3D) ultrasound (US) volume, the 3D US volume including an ultrasound image illustrating the tool within the anatomical region in the 3D US volume;
registering the ultrasound image with the X-ray image;
localizing by a tool tracking device a portion of the tool as located within the ultrasound image based on an identification of the portion of the tool as located within the X-ray image by localizing the portion of the tool along at least one line extending from the X-ray source to a projection of the tool on the X-ray detector thro

Assignees

• Yan Pingkun
• Parthasarathy Vijay
• Manzke Robert
• Jain Ameet Kumar
• Koninklijke Philips Nv

Inventors

• Yan Pingkun
• Parthasarathy Vijay
• Manzke Robert
• Jain Ameet Kumar

Classifications

• A61B8/0883

  for diagnosis of the heart · CPC title

• A61B8/466

  adapted to display 3D data · CPC title

• A61B8/483

  involving the acquisition of a 3D volume of data · CPC title

• A61B6/12 Primary

  Arrangements for detecting or locating foreign bodies · CPC title

• A61B34/20 Primary

  Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis · CPC title