Image processing display device and an image processing display program

Patent metadata

Field	Value
Publication number	US-9659366-B2
Application number	US-201213997812-A
Country	US
Kind code	B2
Filing date	Aug 10, 2012
Priority date	Aug 18, 2011
Publication date	May 23, 2017
Grant date	May 23, 2017

Abstract

An image processing display and an image processing display program that can prevent interference with catheter treatment even when the distal end of a catheter is located behind a treatment apparatus on X-ray fluoroscopic images. The image processing display displays X-ray fluoroscopic images to be obtained by looking through a region including blood vessels using X-rays during treatment, and includes a treatment apparatus image extractor and an image processor. The treatment apparatus image extractor, based on X-ray fluoroscopic images, extracts treatment apparatus images representing the treatment apparatus having the property of absorbing X-rays. The image processor determines the distal end position of the catheter to superimpose and display images representing the determined distal end position of the catheter on the region of the X-ray fluoroscopic images showing the treatment apparatus.

First claim

The invention claimed is:

1. An image processing display device configured to display X-ray fluoroscopic images which are obtained by X-ray fluoroscopic imaging of blood vessels during a hybrid treatment that utilizes a treatment apparatus and a catheter, the image processing display device comprising:
a treatment apparatus image extractor configured to extract, based on the X-ray fluoroscopic images, treatment apparatus images that represent the treatment apparatus; and
an image processor configured to
acquire position information of a distal end of the catheter according to
the X-ray fluoroscopic images when the distal end of the catheter is not located in a region where the treatment apparatus is present in one of the X-ray fluoroscopic images, and
three-dimensional blood stream information, obtained from the X-ray fluoroscopic images, and operational information related to the catheter when the distal end of the catheter is located in the region in the one of the X-ray fluoroscopic images, and

display images corresponding to the position information of the distal end of the catheter, wherein

when the distal end position of the catheter is located in the region where the treatment apparatus is present in the one of the X-ray fluoroscopic images, the image processor creates two-dimensional images of the distal end of the catheter according to the distal end position of the catheter, and displays the two-dimensional images superimposed in the region where the treatment apparatus is present, and
the treatment apparatus is for bypass surgery and absorbs X-rays.

2. The image processing display device according to claim 1 , wherein the image processor does not display the images corresponding to the position information of the distal end of the catheter when the distal end of the catheter is located outside the region while superimposing and displaying the images in the region when the distal end of the catheter is located within the region.

3. The image processing display device according to claim 1 , comprising:
a signal transmitter configured to output signals, the signal transmitter provided on the distal end of the catheter; and
a signal detector configured to receive the output signals, wherein
the image processor comprises a position calculator configured to determine the position information based on the received signals when the distal end of the catheter is determined to be not located in the region where the treatment apparatus is present in the X-ray fluoroscopic image.

4. The image processing display device according to claim 1 , further comprising:
a memory configured to store the three-dimensional blood stream information obtained prior to the hybrid treatment, wherein
the image processor comprises a position calculator configured to determine the distal end position of the catheter based on the blood stream information and operational information according to the catheter.

5. The image processing display device according to claim 4 , wherein the image processor receives X-ray images of blood vessels and, based on the positioning of the X-ray images of the blood vessels and the blood stream information, determines the corresponding positional relation between the images and the blood stream information.

6. The image processing display device according to claim 4 , wherein
the image processor comprises an overlay determination processor configured to determine an angle in the photographing direction of X-rays based on the X-ray fluoroscopic images, the angle allowing direct exposure of the distal end of the catheter without being interfered by the treatment apparatus, and
when the two-dimensional images of the distal end of the catheter are created, the image processor further refers to the distal end position of the catheter that is determined based on the X-ray imaging data obtained by X-rays exposure at the angle in the photographing direction of X-rays.

7. The image processing display device according to claim 4 , wherein
the position calculator is configured to determine
positions of blood bifurcations based on the blood stream information, and
positioning information indicating a corresponding positional relation between the X-ray images of blood vessels and the blood stream information, and

the image processor determines whether or not the positions of the blood bifurcations overlap the region where the treatment apparatus is present from information on the region where the treatment apparatus is present in the X-ray fluoroscopic image and the positions of the blood bifurcations based on the distal end position of the catheter and creates the two-dimensional images of the blood bifurcations related to the X-ray fluoroscopic images when the blood bifurcations are located behind the treatment apparatus.

8. The image processing display device according to claim 4 , wherein the blood stream information includes three-dimensional blood vessel cores images representing blood vessel cores.

9. The image processing display device according to claim 8 , further comprising:
a blood vessel core extractor configured to extract the blood vessel core images based on the three-dimensional blood stream information, wherein
the blood stream information is created based on the three-dimensional blood stream information of the region including the blood vessels.

10. The image processing display device according to claim 8 , further comprising a blood vessel core calculator configured to calculate the blood vessel core images by analyzing blood stream information according to changes in angiograms based on X-ray images of the blood vessels created from X-ray fluoroscopic images in a plurality of time phases.

11. A non-transitory computer readable medium including computer executable instructions to execute an image processing display program during a hybrid treatment that utilizes a treatment apparatus and a catheter, which cause a computer to:
preliminarily store three-dimensional images of blood vessels, the three-dimensional images created based on three-dimensional data of a region including the blood vessels;
preliminarily obtain X-ray images of the blood vessels;
extract three-dimensional blood vessel core images, representing blood vessel cores, based on the three-dimensional data;
create X-ray fluoroscopic images based on X-ray fluoroscopic data;
extract treatment apparatus images, based on the X-ray fluoroscopic images, that represent the treatment apparatus;
determine positioning information that is a corresponding positional relation of the three-dimensional images of the blood vessels to the X-ray images of the blood vessels;
acquire position information of a distal end of the catheter according to:
the X-ray fluoroscopic images when the distal end of the catheter is not located in a region where the treatment apparatus is present in one of the X-ray fluoroscopic images, and
three-dimensional blood stream information, obtained from the X-ray fluoroscopic images, and operational information related to the catheter when the distal end of the catheter is located in the region where the treatment apparatus is present in the one of the X-ray fluoroscopic images;

display images corresponding to the position information of the distal end of the catheter; and
when the distal end position of the catheter is located in the region where the treatment apparatus is present in the one of the X-ray fluoroscopic images,
create two-dimensional images of the distal end of the catheter superimposed on the treatment apparatus images based on the distal end of the catheter and the treatment apparatus images; and

display the two-dimensional images superimposed in th

Assignees

• Yokota Tetsuya
• Kawasaki Tomohiro
• Wakai Satoshi
• Toshiba Medical Sys Corp

Inventors

• Yokota Tetsuya
• Kawasaki Tomohiro
• Wakai Satoshi

Classifications

• A61B6/12

  Arrangements for detecting or locating foreign bodies · CPC title

• A61B2034/102

  Modelling of surgical devices, implants or prosthesis · CPC title

• A61B2090/376

  using X-rays, e.g. fluoroscopy · CPC title

• A61B34/10 Primary

  Computer-aided planning, simulation or modelling of surgical operations · CPC title

• A61B2034/2065

  Tracking using image or pattern recognition · CPC title