Methods and apparatuses for quantifying vascular fluid motions from DSA

Patent metadata

Field	Value
Publication number	US-10499870-B2
Application number	US-201715600493-A
Country	US
Kind code	B2
Filing date	May 19, 2017
Priority date	May 19, 2017
Publication date	Dec 10, 2019
Grant date	Dec 10, 2019

Abstract

Disclosed is a method and an apparatus for quantifying vascular fluid motions from digital subtraction angiography (DSA) images, comprising: calculating an optical flow field between two temporal consecutive DSA images; and estimating a displacement of blood or tissue between the two temporal consecutive DSA images from the calculated optical flow field, wherein the optical flow field is calculated by solving a minimization problem of a CLG energy function, wherein the CLG energy function combines the temporally extended variant of Horn-Schunck approach with Lucas-Kanade approach non-linearly in spatiotemporal approach. The present disclosure provides a new optical flow solution significantly reducing the computation cost with a high robustness for quantifying vascular fluid motions from DSA.

First claim

What is claimed is:

1. A method for quantifying vascular fluid motions from digital subtraction angiography (DSA) images, comprising:
calculating an optical flow field between two temporal consecutive DSA images; and
estimating a displacement of blood or tissue between the two temporal consecutive DSA images from the calculated optical flow field,
wherein the optical flow field is calculated by solving a minimization problem of a combined local global (CLG) energy function, wherein the CLG energy function combines the temporally extended variant of Horn-Schunck approach with Lucas-Kanade approach non-linearly in spatiotemporal approach,
wherein the CLG energy function is established by:
establishing an energy function by Horn-Schunck approach, which includes an energy term and a regularization term, wherein the energy term is determined by an estimated optical flow increment field and a gradient of an intensity field, and the intensity field is extended from a spatial field to a spatial-temporal field according to the two temporal consecutive DSA images; and
transforming the gradient of the intensity field in a spatial-temporal vector space to a localized spatial-temporal derivative smoothing tensor by a convolution kernel, wherein the localized spatial-temporal derivative smoothing tensor is defined as J ρ (∇ 3 I)=K ρ *(∇ 3 I∇ 3 I T ), wherein ρ denotes for a localized constant flow assumed in Lucas-Kanade approach, K ρ denotes for a Gaussian kernel with standard deviation ρ, I denotes for the intensity field of DSA images, ∇ 3 I=[I x , I y , I t ] T , denoting for the gradient of the intensity field of DSA images, wherein

I
x

=

∂
I

∂
x

,

I
y

=

∂
I

∂
y

⁢

⁢
and
⁢

⁢

I
t

=

∂
I

∂
t

,

x and y denote for a two-dimensional spatial position, t denotes for a time.

2. The method according to claim 1 , wherein calculating the optical flow field comprising:
setting a plurality of image pyramid levels from coarse to fine;
at each of the plurality of image pyramid levels, calculating an optical flow increment between the two temporal consecutive DSA images which minimizes the CLG energy function; and
calculating an interpolated sum of the optical flow increment fields calculated over all the plurality of image pyramid levels so as to obtain the optical flow field.

3. The method according to claim 2 , wherein the CLG energy function is further established by:
wrapping the intensity field by the estimated optical flow increment field.

4. The method according to claim 3 , further comprising:
assuming a localized flow to be constant and representing the localized flow as a Gaussian kernel convolution in the CLG energy function.

5. The method according to claim 3 , wherein the regularization term is determined by a regularization parameter and an optical flow field wrapped by the estimated optical flow increment field according to the two temporal consecutive DSA images.

6. The method according to claim 5 , wherein at each level of image pyramid, the localized spatial-temporal derivative smoothing tensor is further defined as a term determined by ∇ 3 I(p+δw (m) ),
wherein p denotes for a spatial-temporal position including the two-dimensional spatial position and the time point, δw (m) denotes for a estimated optical flow increment field at an image pyramid level m, I(p+δw (m) ) denotes for the second DSA image wrapped by δw (m) .

7. The method according to claim 6 , wherein at each level of image pyramid, the regularization term is defined as α(∥∇(w (m) +δw (m) )∥ 2 ,
wherein α denotes for the regularization parameter, w (m) denotes for a optical flow field at the image pyramid level m, w (m) +δw (m) denotes for the optical flow field at the image pyramid level m wrapped by δw (m) .

8. The method according to claim 7 , wherein the minimization problem of the CLG energy function is solved by successive over-relaxation approach.

9. The method according to claim 8 , wherein the successive over-relaxation approach comprising: at each image pyramid level,
setting an initial optical flow field;
iteratively renewing the optical flow field, wherein in each iterative step, a new velocity at pixel i within the image domain is determined by a current velocity at the pixel i, relaxation parameter ω, a current velocity at neighbor pixels of the pixel i, the localized spatial-temporal derivative smoothing tensor, and the regularization term α; and
stopping the iteration and obtaining a final optical flow field at current pyramid level when the criterion for stopping iteration is met.

10. An apparatus for quantifying vascular fluid motions from digital subtraction angiography (DSA) images, comprising:
at least one processor; and
a memory storing instructions, the instructions when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:
calculating an optical flow field between two temporal consecutive DSA images; and
estimating a displacement of blood or tissue between the two temporal consecutive DSA images from the calculated optical flow field,
wherein the optical flow field is calculated by solving a minimization problem of a combined local global (CLG) energy function, wherein the CLG energy function combines the temporally extended variant of Horn-Schunck approach with Lucas-Kanade approach non-linearly in spatiotemporal approach,
wherein the CLG energy function is established by:
establishing an energy function by Horn-Schunck approach, which includes an energy term and a regularization term, wherein the energy term is determined by an estimated optical flow increment field and a gradient of an intensity field, and the intensity field is extended from a spatial field to a spatial-temporal field according to the two temporal consecutive DSA images; and
transforming the gradient of the intensity field in a spatial-temporal vector space to a localized spatial-temporal derivative smoothing tensor by a convolution kernel, wherein the localized spatial-temporal derivative smoothing tensor is defined as J ρ (∇ 3 I)=K ρ *(∇ 3 I∇ 3 I T ), wherein ρ denotes for a localized constant flow assumed in Lucas-Kanade approach, K ρ denotes for a Gaussian kernel with standard deviation ρ, I denotes for the in

Assignees

• Univ Hong Kong Chinese

Inventors

• Wang Defeng
• Ko Ka Long

Classifications

• G16H50/30

  for calculating health indices; for individual health risk assessment · CPC title

• G06T2207/10064

  Fluorescence image · CPC title

• G06T7/269

  using gradient-based methods · CPC title

• G06T2207/20016

  Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform · CPC title

• G06T2207/20224

  Image subtraction · CPC title