Method and system for machine learning based assessment of fractional flow reserve

Patent metadata

Field	Value
Publication number	US-9974454-B2
Application number	US-201715616380-A
Country	US
Kind code	B2
Filing date	Jun 7, 2017
Priority date	Oct 17, 2013
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

A method and system for determining fractional flow reserve (FFR) for a coronary artery stenosis of a patient is disclosed. In one embodiment, medical image data of the patient including the stenosis is received, a set of features for the stenosis is extracted from the medical image data of the patient, and an FFR value for the stenosis is determined based on the extracted set of features using a trained machine-learning based mapping. In another embodiment, a medical image of the patient including the stenosis of interest is received, image patches corresponding to the stenosis of interest and a coronary tree of the patient are detected, an FFR value for the stenosis of interest is determined using a trained deep neural network regressor applied directly to the detected image patches.

First claim

The invention claimed is:

1. A method for determining a hemodynamic metric to assess a stenosis of interest for a patient, comprising:
receiving a medical image of the patient including the stenosis of interest;
detecting image patches corresponding to the stenosis of interest and a coronary tree of the patient; and
determining a value of at least one hemodynamic metric for the stenosis of interest using a trained deep neural network regressor applied directly to the detected image patches without first extracting features from the medical image, wherein the trained deep neural network regressor is trained using a first set of training image patches without corresponding values of the at least one hemodynamic metric to train weights of layers other than a final layer of the deep neural network regressor and a second set of training image patches including identified stenosis image patches and corresponding values of the at least one hemodynamic metric to refine the weights of all layers including the final layer of the deep neural network regressor.

2. The method of claim 1 , wherein detecting image patches corresponding to the stenosis of interest and a coronary tree of the patient comprises:
detecting image patches corresponding to the stenosis of interest, coronary ostia, coronary vessels, and coronary bifurcation and trifurcations.

3. The method of claim 1 , wherein detecting image patches corresponding to the stenosis of interest and a coronary tree of the patient comprises:
detecting the image patches in a series of marginal parameter spaces using a respective trained deep neural network for each of the marginal parameter spaces.

4. The method of claim 3 , wherein the series of marginal parameter spaces comprises a position parameter space, a position-orientation parameter space, and a position-orientation-scale parameter space.

5. The method of claim 3 , wherein the respective trained deep neural network for each of the marginal parameter spaces comprises a deep neural network regressor trained that inputs hypotheses in the respective parameter space and for each hypothesis, outputs a displacement vector that provides a prediction for an image patch in the respective parameter space.

6. The method of claim 3 , wherein the respective trained deep neural network for each of the marginal parameter spaces comprises a discriminative deep neural network that inputs hypotheses in the respective parameters space, and for each hypothesis outputs a probability for the image patch corresponding to the hypothesis.

7. The method of claim 3 , wherein the respective deep neural network for each of the marginal parameter spaces is a deep multi-layer neural network trained using one of a convolutional neural network (CNN), a stacked restricted Boltzmann machine (RBM), or a stacked auto-encoder (AE).

8. The method of claim 1 , wherein the trained deep neural network regressor is a deep neural network with a plurality of layers and the final layer calculates a stenosis specific value for the at least one hemodynamic metric.

9. The method of claim 8 , wherein the trained deep neural network is trained by tuning weights for each layer other than the final layer using the first set of training image patches without corresponding values of the at least one hemodynamic metric using restricted Boltzmann machines (RBM) contrastive divergences or Auto-encoders algorithms and then refining the weights for each layer including the final layer based on the second set of training image patches with corresponding values of the at least one hemodynamic metric using gradient descent back-propagation.

10. The method of claim 1 , wherein the trained deep neural network regressor includes a first hidden layer at which learned weights map raw image data from the detected image patches to a first set of latent variables, a second hidden layer at which learned weights map the first set of latent variables to a second set of latent variables, a third hidden layer at which learned weights map the second set of latent variables to a third set of latent variables, and the final layer at which learned weights map the third set of latent variables to a stenosis specific value of the at least one hemodynamic metric.

11. The method of claim 1 , wherein the at least one hemodynamic metric comprises one or more of fractional flow reserve (FFR), pressure-drop, coronary flow reserve (CFR), instantaneous wave-free ratio (IFR), hyperemic stress reserve (HSR), basal stenosis resistance (BSR), or index of microcirculatory resistance (IMR).

12. An apparatus for determining a hemodynamic metric to assess a stenosis of interest for a patient, comprising:
a processor; and
a memory storing computer program instructions, which when executed by the processor cause the processor to perform operations comprising:
receiving a medical image of the patient including the stenosis of interest;
detecting image patches corresponding to the stenosis of interest and a coronary tree of the patient; and
determining a value of at least one hemodynamic metric for the stenosis of interest using a trained deep neural network regressor applied directly to the detected image patches without first extracting features from the medical image, wherein the trained deep neural network regressor is trained using a first set of training image patches without corresponding values of the at least one hemodynamic metric to train weights of layers other than a final layer of the deep neural network regressor and a second set of training image patches including identified stenosis image patches and corresponding values of the at least one hemodynamic metric to refine the weights of all layers including the final layer of the deep neural network regressor.

13. The apparatus of claim 12 , wherein detecting image patches corresponding to the stenosis of interest and a coronary tree of the patient comprises:
detecting image patches corresponding to the stenosis of interest, coronary ostia, coronary vessels, and coronary bifurcation and trifurcations.

14. The apparatus of claim 12 , wherein detecting image patches corresponding to the stenosis of interest and a coronary tree of the patient comprises:
detecting the image patches in a series of marginal parameter spaces using a respective trained deep neural network for each of the marginal parameter spaces.

15. The apparatus of claim 14 , wherein the series of marginal parameter spaces comprises a position parameter space, a position-orientation parameter space, and a position-orientation-scale parameter space.

16. The apparatus of claim 14 , wherein the respective trained deep neural network for each of the marginal parameter spaces comprises a deep neural network regressor trained that inputs hypotheses in the respective parameter space and for each hypothesis, outputs a displacement vector that provides a prediction for an image patch in the respective parameter space.

17. The apparatus of claim 14 , wherein the respective trained deep neural network for each of the marginal parameter spaces comprises a discriminative deep neural network that inputs hypotheses in the respective parameters space, and for each hypothesis outputs a probability for the image patch corresponding to the hypothesis.

18. The apparatus of claim 14 , wherein the respective deep neural network for each of the marginal parameter spaces is a deep multi-layer neural network trained using one of a convolutional neural network (CNN), a stacked restricted Boltzmann machine (RBM), or a stacked auto-encoder (AE).

Assignees

• Siemens Healthcare Gmbh

Inventors

• Sharma Puneet
• Kamen Ali
• Georgescu Bogdan
• Sauer Frank
• Comaniciu Dorin
• Zheng Yefeng
• Nguyen Hien
• Singh Vivek Kumar

Classifications

• G06V10/774 Primary

  Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting · CPC title

• A61B5/026 Primary

  Measuring blood flow {(A61B3/1233, A61B3/1241 take precedence)} · CPC title

• G06F18/214

  Generating training patterns; Bootstrap methods, e.g. bagging or boosting · CPC title

• G06T7/0012

  Biomedical image inspection · CPC title

• G06T7/0016

  involving temporal comparison · CPC title