Device and method for acquiring fusion image

Patent metadata

Field	Value
Publication number	US-2016192840-A1
Application number	US-201314909388-A
Country	US
Kind code	A1
Filing date	Aug 1, 2013
Priority date	Aug 1, 2013
Publication date	Jul 7, 2016
Grant date	—

Abstract

Disclosed is a device and method for acquiring a fusion image, which applies an ultrasound signal for an ultrasound image, an optical signal for a photoacoustic image and a fluorescent image to a target, receives an ultrasound signal, a photoacoustic signal and an optical signal from the target, and generates a fusion image including image information with different probing planes with respect to the target by using at least two signals of the received ultrasound signal, the received photoacoustic signal and the received optical signal.

First claim

1 . A device for acquiring an image, comprising:
a sound source configured to apply an ultrasound signal for an ultrasound (US) image to a target; a light source configured to apply an optical signal for a photoacoustic (PA) image and a fluorescent (FL) image to the target; a sound probing unit configured to receive the ultrasound signal generated by the sound source and the photoacoustic signal generated by the light source from the target; a light probing unit configured to receive the optical signal generated by the light source from the target; and an image generating unit configured to generate a fusion image including image information with different probing planes with respect to the target by using at least two signals of the received ultrasound signal, the received photoacoustic signal and the received optical signal.

2 . The device for acquiring an image according to claim 1 ,
wherein the image generating unit generates a single fusion image by: generating a depth image of the target from the received ultrasound signal or the received photoacoustic signal, generating a planar image of the target from the received optical signal, and mapping the generated depth image and the generated planar image.

3 . The device for acquiring an image according to claim 1 ,
wherein the image generating unit determines a feature point from each of the images with different probing planes, and maps the determined feature points to generate an image where a relation among the images is visually matched and displayed.

4 . The device for acquiring an image according to claim 1 ,
wherein the sound probing unit is located adjacent to the target, and wherein the light probing unit is installed to be located relatively far from the target in comparison to the sound probing unit.

5 . The device for acquiring an image according to claim 1 ,
wherein the sound probing unit and the light probing unit are installed along different axes to prevent signal interference from each other.

6 . The device for acquiring an image according to claim 1 , further comprising:
a switch for shifting operations of the sound probing unit and the light probing unit to each other, wherein a signal corresponding to each probing unit is received according to a manipulation of a user on the switch.

7 . A device for acquiring an image, comprising:
a sound source configured to apply an ultrasound signal for an ultrasound image to a target; a light source configured to apply an optical signal for a photoacoustic image and a fluorescent image to the target; a sound probing unit configured to receive the ultrasound signal generated by the sound source and the photoacoustic signal generated by the light source from the target; a light probing unit configured to receive the optical signal generated by the light source from the target; a location control unit configured to adjust physical locations of the sound probing unit and the light probing unit; and an image generating unit configured to generate a fusion image including image information with different probing planes with respect to the target by using at least two signals of the received ultrasound signal, the received photoacoustic signal and the received optical signal according to the adjusted locations.

8 . The device for acquiring an image according to claim 7 ,
wherein the image generating unit generates a single fusion image by: generating a three-dimensional image by moving the sound probing unit along a surface of the target according to the control of the location control unit to laminate a depth image of the target from the received ultrasound signal or the received photoacoustic signal, generating a planar image of the target by fixing the location of the light probing unit according to the control of the location control unit, and mapping the generated three-dimensional image and the generated planar image in consideration of the adjusted location.

9 . The device for acquiring an image according to claim 7 ,
wherein the location control unit moves the sound probing unit in a longitudinal direction along a surface of the target based on the light probing unit to guide successive generation of depth images corresponding to the planar image by the light probing unit.

10 . The device for acquiring an image according to claim 7 ,
wherein the sound probing unit is located adjacent to the target, wherein the light probing unit is installed to be located relatively far from the target in comparison to the sound probing unit, and wherein the sound probing unit receives a sound signal from the target while changing the location thereof according to the control of the location control unit.

11 . The device for acquiring an image according to claim 7 , further comprising:
an optical and/or acoustical transparent front which is adjacent to the target and has permeability with respect to an optical signal and a sound signal.

12 . A method for acquiring an image, comprising:
applying an ultrasound signal for an ultrasound image or an optical signal for a photoacoustic image to a target, and receiving an ultrasound signal or photoacoustic signal corresponding to a signal applied from the target; applying an optical signal for a fluorescent image to the target, and receiving an optical signal from the target; and generating a fusion image including image information with different probing planes with respect to the target by using at least two signals of the received ultrasound signal, the received photoacoustic signal and the received optical signal, wherein the fusion image includes a depth image generated from the received ultrasound signal or the received photoacoustic signal, a planar image generated from the received optical signal and mapping information between the depth image and the planar image.

13 . The method for acquiring an image according to claim 12 , further comprising:
displaying the generated fusion image on a display device, wherein the depth image and the planar image included in the fusion image are shifted to each other according to a manipulation of a user to be displayed simultaneously or in order.

14 . The method for acquiring an image according to claim 12 , further comprising:
generating a three-dimensional image by moving a probing unit for receiving the ultrasound signal or photoacoustic signal in a longitudinal direction along a surface of the target based on the probing unit for the fluorescent image, so that the depth image is successively laminated corresponding to the planar image, wherein the generating of a fusion image generates a single fusion image by mapping the generated three-dimensional image and the generated planar image in consideration of the adjusted location.

15 . The method for acquiring an image according to claim 12 , further comprising:
determining a feature point from each of the images with different probing planes, and mapping the determined feature points, wherein the generating of a fusion image generates an image in which a relation among the images is visually matched and displayed.

16 . The method for acquiring an image according to claim 12 , further comprising:
displaying the ultrasound image, the photoacoustic image and the fluorescent image on a display device simultaneously; and generating an overlaying image in which at least two images selected by a user are overlaid, and displaying the overlaying image on the display device.

17 . The method for acquiring an image according to claim 12 , further comprising:
receiving an

Assignees

• Univ Sogang Res Foundation

Inventors

• Chang Jin Ho
• Song Tai-Kyong
• Yoo Yang Mo
• Kang Jeeun
• Wilson Brian
• Kim Kang
• Han Seung Hee

Classifications

• A61B8/5207

  involving processing of raw data to produce diagnostic data, e.g. for generating an image · CPC title

• A61B5/0035 Primary

  adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography · CPC title

• A61B5/0095

  by applying light and detecting acoustic waves, i.e. photoacoustic measurements · CPC title

• A61B5/0059

  using light, e.g. diagnosis by transillumination, diascopy, fluorescence (photoacoustic A61B5/0093; optical measurement of heart rate A61B5/02416; optical measurement of blood flow A61B5/0261; optical measurement of analytes A61B5/1455) · CPC title

• A61B8/5246

  combining images from the same or different imaging techniques, e.g. color Doppler and B-mode · CPC title