System and method for image composition

Patent metadata

Field	Value
Publication number	US-9824503-B2
Application number	US-201615394923-A
Country	US
Kind code	B2
Filing date	Dec 30, 2016
Priority date	Sep 22, 2014
Publication date	Nov 21, 2017
Grant date	Nov 21, 2017

Abstract

A system and method for obtaining a composite image by combining multiple sub-images are provided. In some embodiments, the method may include retrieving overlapping images corresponding to sub-images including 3D volume data, generating two-dimensional (2D) projection images and pixel maps based on the overlapping images, performing one or more registrations based on the 2D projection images and the pixel maps, calibrating the sub-images based on the results of the registration(s), and fusing the sub-images to produce a composite image. In some embodiments, the method may include setting a plurality of parameters relating to an X-radiation source or a radiation detector based on a preliminary number of exposures and a preliminary exposure region, controlling, based on at least one of the plurality of parameters, a motion of the X-radiation source or a motion of the radiation detector to capture a plurality of sub-images, and combining the plurality of sub-images.

First claim

We claim:

1. A method implemented on at least one device each of which has at least one processor and storage, the method comprising:
retrieving a first sub-image and a second sub-image; the first sub-image corresponding to a first set of 3D volume data, and the second sub-image corresponding to a second set of 3D volume data;
retrieving a first overlapping image from the first sub-image;
retrieving a second overlapping image from the second sub-image;
generating a first 2D projection image and a first pixel map based on maximum intensity projection of the first overlapping image onto a plane;
generating a second 2D projection image and a second pixel map based on maximum intensity projection of the second overlapping image onto the plane;
performing 2D registration based on the first 2D projection image, the first pixel map, the second 2D projection image, and the second pixel map;
performing 3D registration based on the 2D registration, the first pixel map, or the second pixel map;
identifying a correlation between of the first sub-image including the first overlapping image and the second sub-image including the second overlapping image based on the 2D registration or the 3D registration; and
fusing the first overlapping image and the second overlapping image based on the correlation to provide a composite image.

2. The method of claim 1 , the performing 3D registration comprising
calculating a plurality of differences between first locations of maximum intensity of the first overlapping image in the direction perpendicular to the plane and second locations of maximum intensity of the second overlapping image in the direction perpendicular to the plane, each one of the plurality of differences corresponding to a pixel within the plane;
comparing the plurality of differences to obtain a probability of the differences; and
designating an offset in the direction perpendicular to the plane based on the probability.

3. The method of claim 1 , the first sub-image or the second sub-image comprising a coronal image, a sagittal image, or a transverse image.

4. The method of claim 1 , the plane comprising a coronal plane, a sagittal plane, or a transverse plane.

5. The method of claim 1 , retrieving the first sub-image or retrieving the second sub-image comprising using DSA (digital subtraction angiography), CT (computed tomography), CTA (computed tomography angiography), PET (positron emission tomography), X-ray, MRI (magnetic resonance imaging), MRA (magnetic resonance angiography), SPECT (single-photon emission computerized tomography), or US (ultrasound scanning).

6. The method of claim 1 , retrieving the first overlapping image or retrieving the second overlapping image comprising using Digital Imaging and Communication in Medicine.

7. The method of claim 1 , performing 2D registration comprising calculating an offset in a direction within the plane, and
the offset comprising an X offset, a Y offset, a Z offset, a coronal offset, a sagittal offset, or a transverse offset.

8. The method of claim 1 , the performing 3D registration comprising calculating an offset in a direction perpendicular to the plane, and the offset comprising an X offset, a Y offset, a Z offset, a coronal, a sagittal offset, or a transverse offset.

9. The method of claim 1 further comprising
performing a fine registration based on recursion, a bisection method, an exhaustive method, a greedy algorithm, a divide and conquer algorithm, dynamic programming method, an iterative method, a branch-and-bound algorithm, or a backtracking algorithm.

10. The method of claim 1 , the first pixel map comprising information identifying first locations of maximum intensity of the first overlapping image, the first locations being in a direction perpendicular to the plane; and
the second pixel map comprising information identifying second locations of maximum intensity of the second overlapping image, the second locations being in a direction perpendicular to the plane.

11. The method of claim 10 , the performing 3D registration comprising
calculating a plurality of differences between the first locations and the second locations, each one of the plurality of differences corresponding to a pixel within the plane;
comparing the plurality of differences to obtain a probability of the differences; and
designating an offset in the direction perpendicular to the plane based on the probability.

12. The method of claim 11 , the second pixel map comprising a calibrated pixel map based on the 2D registration.

13. A non-transitory computer readable medium comprising executable instructions that, when executed by at least one processor, cause the at least one processor to effectuate a method comprising:
retrieving a first sub-image and a second sub-image; the first sub-image corresponding to a first set of 3D volume data, and the second sub-image corresponding to a second set of 3D volume data;
retrieving a first overlapping image from the first sub-image;
retrieving a second overlapping image from the second sub-image;
generating a first 2D projection image and a first pixel map based on maximum intensity projection of the first overlapping image onto a plane;
generating a second 2D projection image and a second pixel map based on maximum intensity projection of the second overlapping image onto the plane;
performing 2D registration based on the first 2D projection image, the first pixel map, the second 2D projection image, and the second pixel map;
performing 3D registration based on the 2D registration, the first pixel map, or the second pixel map;
identifying a correlation between of the first sub-image including the first overlapping image and the second sub-image including the second overlapping image based on the 2D registration or the 3D registration; and
fusing the first overlapping image and the second overlapping image based on the correlation to provide a composite image.

14. The non-transitory computer readable medium of claim 13 , the first sub-image or the second sub-image comprising a coronal image, a sagittal image, or a transverse image.

15. The non-transitory computer readable medium of claim 13 , the plane comprising a coronal plane, a sagittal plane, or a transverse plane.

16. The non-transitory computer readable medium of claim 13 , retrieving the first sub-image or retrieving the second sub-image comprising using DSA (digital subtraction angiography), CT (computed tomography), CTA (computed tomography angiography), PET (positron emission tomography), X-ray, MRI (magnetic resonance imaging), MRA (magnetic resonance angiography), SPECT (single-photon emission computerized tomography), or US (ultrasound scanning).

Assignees

• Shanghai United Imaging Healthcare Co Ltd

Inventors

• Yu Wenjun
• Jin Xiangcui
• Hu Yang
• Xiao Haifeng
• Chen Hongwei
• Wang Wei

Classifications

• G16H30/20

  for handling medical images, e.g. DICOM, HL7 or PACS · CPC title

• G16H30/40

  for processing medical images, e.g. editing · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title

• G06T2207/10081

  Computed x-ray tomography [CT] · CPC title