Matching patient images of different imaging modality using atlas information

Patent metadata

Field	Value
Publication number	US-9639938-B2
Application number	US-201314437784-A
Country	US
Kind code	B2
Filing date	Jun 28, 2013
Priority date	Oct 26, 2012
Publication date	May 2, 2017
Grant date	May 2, 2017

Abstract

The present invention relates to a medical data processing method of transforming a representation of an anatomical structure of a patient in a first imaging modality into a representation of the anatomical structure in a second, other imaging modality, the method being constituted to be executed by a computer and comprising the following steps: acquiring first modality image data describing the first modality medical image containing the representation of the anatomical structure in the first imaging modality; acquiring atlas data describing a first modality atlas image describing a general structure of the anatomical structure in the first imaging modality, the atlas data containing information about the representation of the general structure in the second imaging modality; determining, based on the first modality image data and the atlas data, a first matching transformation between the first modality medical image and the first modality atlas image; determining, based on the first matching transformation and the first modality atlas image and the information about the representation of the general structure in the second imaging modality second modality, a second modality image representation of the first modality medical image.

First claim

The invention claimed is:

1. A system, comprising:
at least one medical imaging device for generating patient images of a patient; and
at least one computer for transforming a representation of an anatomical structure of a patient in a first imaging modality into a representation of the anatomical structure in a second, other imaging modality, the computer having memory and instructions that when executed, perform the following steps:
acquire first modality image data describing a first modality medical image generated by the medical imaging device, the first modality medical image containing the representation of the anatomical structure in the first imaging modality;
acquire atlas data describing a first modality atlas image describing a general structure of the anatomical structure in the first imaging modality, the atlas data containing information about the representation of the general structure in the second imaging modality;
determine, used on the first modality image data and the atlas data, a first matching transformation between the first modality medical image and the first modality atlas image;
determine, based on the first matching transformation and the first modality atlas image and the information about the representation of the general structure in the second imaging modality, a second modality image representation of the first modality medical image;
acquire second modality image data describing a second modality medical image containing the representation of the anatomical structure in the second imaging modality;
determine based on the second modality image representation and the second modality image data, a second matching transformation between the second modality image representation and the second modality medical image;
define a structural change region in the second modality image representation, the structural change region including a placeholder representing a structural change of the anatomical structure; and
adapt the second matching transformation to a difference between the representations of the anatomical structure in the second modality representation and the second modality medical image by modifying the placeholder.

2. A computer implemented method of transforming a representation of an anatomical structure of a patient in a first imaging modality into a representation of the anatomical structure in a second, other imaging modality, comprising:
acquiring, at one or more processors of the computer, first modality image data describing the first modality medical image containing the representation of the anatomical structure in the first imaging modality;
acquiring, at one or more of the processors of the computer, atlas data describing a first modality atlas image describing a general structure of the anatomical structure in the first imaging modality, the atlas data containing information about the representation of the general structure in the second imaging modality;
determining, by one or more of the processors of the computer and based on the first modality image data and the atlas data, a first matching transformation between the first modality medical image and the first modality atlas image;
determining, by one or more of the processors of the computer and based on the first matching transformation and the first modality atlas image and the information about the representation of the general structure in the second imaging modality, a second modality image representation of the first modality medical image;
acquiring, at one or more of the processors of the computer, second modality image data describing a second modality medical image containing the representation of the anatomical structure in the second imaging modality;
determining, by one or more of the processors of the computer and based on the second modality image representation and the second modality image data, a second matching transformation between the second modality image representation and the second modality medical image;
defining, by one or more of the processors of the computer, a structural change region in the second modality image representation, the structural change region comprising a placeholder for a data structure representing a structural change of the anatomical structure; and
adapting the second matching transformation to a difference between the representations of the anatomical structure in the second modality representation and the second modality medical image by modifying the placeholder.

3. The method according to claim 2 , wherein a matched first modality atlas image is determined by applying the first matching transformation to the first modality atlas image, and wherein the first matching transformation is determined based on the matched first modality atlas image.

4. The method according to claim 2 , wherein the atlas data describes a second modality atlas image describing a general structure of the anatomical structure in the second image modality, and
wherein the information about the representation of the general structure in the second imaging modality is determined based on the second modality atlas image.

5. The method according to claim 4 , wherein the second modality image representation is determined based on determining a modality transformation between the matched first modality atlas image and the second modality atlas image.

6. The method according to claim 5 , comprising:
acquiring, at one or more of the processors of the computer, representation class data describing a representation class of the image elements describing the representation of the general structure of the anatomical structure in the first imaging modality and in the second imaging modality, wherein the representation class describes at least one of colour contrasts, colour values and type of physical structure represented by the image elements,
wherein the modality transformation is determined based on the representation class data.

7. The method according to claim 2 , comprising:
acquiring, at one or more of the processors of the computer, imaging modality data describing the first imaging modality and the second imaging modality,
wherein the first matching transformation and the second modality image representation are determined based on the imaging modality data.

8. The method according to claim 7 , wherein also the second matching transformation is determined based on the imaging modality data.

9. The method according to claim 7 , wherein the representation class describes a grey value.

10. The method according to claim 7 , comprising:
determining, by one or more of the processors of the computer, similarity data describing a measure of similarity between the second modality image representation and the second modality medical image, wherein the measure of similarity is determined based on a similarity between the second modality image representation and the second modality medical image with regard to the representation class of the respective image elements describing the anatomical structure.

11. The method according to claim 10 , wherein the measure of similarity includes a cross-correlation between at least one of colour contrasts and colour values in the second modality image representation and the second modality medical image.

12. The method according to claim 9 , wherein regions in the second modality image representation and the second modality medical image for which at least substantially no similarity has been determined are excluded as a basis for determining the second matching transformation.

13. The method according to claim 2 , wherein the first matching transformation and the second matching

Assignees

• Brainlab Ag

Inventors

• Blumhofer Andreas
• Varkuti Bálint
• Schmaler Jens

Classifications

• G06T12/30

  Image post-processing, e.g. metal artefact correction · CPC title

• G06T2207/10084

  Hybrid tomography; Concurrent acquisition with multiple different tomographic modalities · CPC title

• G06T2207/20104

  Interactive definition of region of interest [ROI] · CPC title

• G06T2207/10004

  Still image; Photographic image · CPC title

• G06T2207/20221

  Image fusion; Image merging · CPC title