Multi-task learning based regions-of-interest enhancement in PET image reconstruction

Patent metadata

Field	Value
Publication number	US-12367622-B2
Application number	US-202218087743-A
Country	US
Kind code	B2
Filing date	Dec 22, 2022
Priority date	Jun 30, 2021
Publication date	Jul 22, 2025
Grant date	Jul 22, 2025

Abstract

Disclosed is a method for region-of-interest enhanced PET image reconstruction based on multi-task learning, which comprises the following steps: firstly, acquiring a backprojection image of the PET original data, and designing a main task of establishing a mapping between the backprojection image and a reconstructed PET image by using a three-dimensional deep convolution neural network. A new auxiliary task 1 is designed to predict a computerized tomography (CT) image with the same anatomical structures as the PET image reconstructed from the backprojection image, so as to reduce the noise in the reconstructed PET image by using the local smoothing information of the high-resolution CT image.

First claim

What is claimed is:

1. A method for region of interest (ROI) enhanced Positron Emission Tomography (PET) image reconstruction based on multi-task learning, wherein the method completes reconstruction by feeding a PET backprojection image to reconstruct into a trained reconstruction mapping network to obtain a reconstructed PET image, wherein the reconstruction mapping network comprises a shared encoder and a reconstruction decoder, and is obtained by:
(1) constructing a training data set, wherein each sample of the training data set comprises a corresponding PET backprojection image, a reconstructed PET image, a computerized tomography (CT) image obtained by the CT scan before the PET scan, and a ROI mask in the reconstructed PET image; the ROI is a region with specific position and shape characteristics in the reconstructed PET image;
(2) establishing multi-task learning of the shared encoder, wherein the multi-task learning at least comprises:
a main reconstruction task: taking the PET backprojection image as an input of the shared encoder, and learning the mapping from the PET backprojection image to the reconstructed PET image by using an output of the reconstruction decoder;
a new task 1: taking the PET backprojection image as the input of the shared encoder, and learning the mapping from the PET backprojection image to the CT image by using an output of a CT prediction decoder;
a new task 2: taking the PET backprojection image as the input of the shared encoder, and learning the mapping from the PET backprojection image to the mask of the ROIs in the reconstructed PET image by using an output of an ROI prediction decoder;
(3) using the training data set constructed in step (1) to carry out training with a goal of minimizing losses of multi-task learning prediction results and the corresponding truth values, and obtaining a trained reconstructed mapping network;
the losses of the multi-task learning prediction results and the corresponding true values comprise:
a L1 norm error between the reconstructed PET image predicted by the main reconstruction task and a reconstructed PET image label;
a L1 norm error between the CT image predicted in the new task 1 and a CT image label;
a Focal loss between the ROI mask predicted in the new task 2 and a ROI mask label;
a similarity between the reconstructed PET image and the CT image predicted in the new task 1 by the calculation of structural similarity index measurement (SSIM); a L2 norm error between the contrasts of ROIs and a background area of the predicted PET image and the PET image label after applying the ROI mask predicted in the new task 2 thereto.

2. The method according to claim 1 , wherein in the step (1), the PET backprojection image is obtained by back-projecting an original PET data into an image domain after attenuation, random and scatter correction.

3. The method according to claim 1 , wherein in the step (1), the reconstructed PET image is obtained by iteratively reconstructing an original PET data after physical correction.

4. The method according to claim 1 , wherein the reconstruction mapping network is composed of two parts, of which a first part is a U-Net composed of 3D convolution layers, 3D deconvolution layers, and shortcuts therebetween, and a second part is composed of a plurality of residual blocks connected in series; wherein the 3D convolution layers are used as the shared encoder to encode the PET backprojection image and extract high-level features, and the 3D deconvolution layers and the plurality of residual blocks form the reconstruction decoder, which is used to decode the high-level features to obtain the predicted PET image.

Assignees

• Zhejiang Lab

Inventors

• Zhu Wentao
• Yang Bao
• Wu Yuanfeng

Classifications

• G06T12/20 Primary

  Inverse problem, i.e. transformations from projection space into object space · CPC title

• G06T12/30 Primary

  Image post-processing, e.g. metal artefact correction · CPC title

• G06T5/70 Primary

  Denoising; Smoothing · CPC title

• G06T2211/424

  Iterative · CPC title

• G06T2207/20084

  Artificial neural networks [ANN] · CPC title